-- Logs begin at Tue 2022-05-10 01:38:18 UTC, end at Tue 2022-05-10 03:39:50 UTC. -- May 10 02:59:36.230240 dv-cinder-830094-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 02:59:36.239453 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 02:59:36 2022] *** May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: nodename: dv-cinder-830094-4-iscsi May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: machine: x86_64 May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: clock source: unix May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: pcre jit disabled May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: detected number of CPU cores: 4 May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: current working directory: / May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: detected binary path: /usr/bin/uwsgi-core May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: your processes number limit is 47680 May 10 02:59:36.241459 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: your memory page size is 4096 bytes May 10 02:59:36.242082 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: detected max file descriptor number: 2048 May 10 02:59:36.242082 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: lock engine: pthread robust mutexes May 10 02:59:36.242082 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: thunder lock: enabled May 10 02:59:36.242082 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 02:59:36.242082 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 02:59:36.287091 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: Python main interpreter initialized at 0x562bbcb7f9c0 May 10 02:59:36.287091 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: python threads support enabled May 10 02:59:36.287091 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: your server socket listen backlog is limited to 100 connections May 10 02:59:36.287091 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: your mercy for graceful operations on workers is 90 seconds May 10 02:59:36.287443 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: mapped 403077 bytes (393 KB) for 2 cores May 10 02:59:36.287520 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: *** Operational MODE: preforking *** May 10 02:59:36.287772 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: *** uWSGI is running in multiple interpreter mode *** May 10 02:59:36.287772 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: spawned uWSGI master process (pid: 80043) May 10 02:59:36.287971 dv-cinder-830094-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 02:59:36.288526 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: spawned uWSGI worker 1 (pid: 80056, cores: 1) May 10 02:59:36.288895 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: spawned uWSGI worker 2 (pid: 80057, cores: 1) May 10 02:59:36.289057 dv-cinder-830094-4-iscsi devstack@keystone.service[80043]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 02:59:42.009352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:59:42.009352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes May 10 02:59:42.010137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:59:42.010137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: from cryptography.utils import int_from_bytes May 10 02:59:42.010724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:59:42.010724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes May 10 02:59:42.010867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:59:42.010867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: from cryptography.utils import int_from_bytes May 10 02:59:42.059907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:59:42.060084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:59:42.060155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:59:42.060235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:59:42.060303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] command line args: [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:59:42.060374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] command line args: [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:59:42.060611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:59:42.060810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:59:42.060884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ================================================================================ {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:59:42.060950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ================================================================================ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:59:42.061014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] admin_token = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] config_dir = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_dir = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] config_source = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_source = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] debug = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] debug = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.061910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.068506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.068612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.068961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_config_append = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_config_append = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_dir = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_dir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.069940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_file = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.070980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.071961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] publish_errors = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] publish_errors = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.072962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] standard_threads = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] standard_threads = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_journal = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] use_journal = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_json = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] use_json = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_stderr = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] use_stderr = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.073962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_syslog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.074021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] use_syslog = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.074083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.074146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:59:42.074204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.074918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.075977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.076639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.079332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.080890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.081975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.082973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.083933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.084992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.085148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.085281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.085281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.085530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.085659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.086289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.086447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.086589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.086732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.086916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.087068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.087198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.087198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.088627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.088627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.089996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.090222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.090421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.090627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.090830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.091028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.091262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.091475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.091643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.091836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.092066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.092237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.092463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.092632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.092855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.093048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.093284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.093482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.093648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.093817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.094878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.095992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.096884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.097931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.098985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.099912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.100874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.101005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.101257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.102939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.103892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.104909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.105955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.external = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.106885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.password = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.107963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.token = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.external = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.108950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.password = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] auth.token = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.109903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.110957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.111994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.112984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.113944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.114874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.115964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.116863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.117941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.118886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.119936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.120998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.121945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.122892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.123881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.124953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.125884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.126946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.127886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.128964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.129894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.130956 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.131893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.132904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.133965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.134902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.135970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.136911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.137973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.138870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.139923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.140953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.141886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.142888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.143947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.144909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.145974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.146894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] role.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] role.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.147961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.148109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.148783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.148924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.149987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.150963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.151851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.152998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.153137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.153530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.153685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.153823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.153960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.154938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.155925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.156926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.157910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.158886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.159871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.160880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.161873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.162981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.connection = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.163932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.164786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.164937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.165915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.166265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.167388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.167388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:59:42.167388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:59:42.175077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.175305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.175521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.176552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.176805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.177026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.184235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.185782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.213058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.213273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.214317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.214548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.271594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.272106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.321715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.322041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.322424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.322591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.391871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.392988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.393063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.393270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.417980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.418798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.429792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.430258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.444294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.444547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.444766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.444883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.444951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.445012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.445804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.445887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.445958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.446022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.446263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.446343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.446343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.446605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:59:42.464067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.464275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:59:42.464605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.464825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:59:42.464910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:59:42.465173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:59:42.465662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.465903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.466064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.466305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.466554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.477314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.477620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.477886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.478070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.478229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.478371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.478590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.478864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.486248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.486890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.489529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.489808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.490415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.490974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.491821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.492017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.492666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.492827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.492965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.493103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.493341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.493696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.519416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.520112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.521065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.521344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.521795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.522033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.526788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.527063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.527337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.527506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.527698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.527979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.534929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.535208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.535501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.535781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.540389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.540684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.540961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.541260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.541975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.542943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.561315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.561588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.561957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.562226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.566079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.566709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.569695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.569987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.570318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.570607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.574966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.578100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.578543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.581808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.582251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.582551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.582832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.583112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.583384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.583654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.585507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.585824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.586095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.586372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.586643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.586915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.603130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.603500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.603766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.604026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.606413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.606785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.607047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.607307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.611863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.613617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.613893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.615121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.616829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.617547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.617711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.617865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.618083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.618365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.618637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.620934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.621212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.621486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.621763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.622030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.631968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.632244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.632534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.632931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.633213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.633499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.633771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.635522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.635799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.636070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.636354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.636624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.636924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.637192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.652205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.655740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.659113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.660724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.662361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.662833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.663245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.663616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.667592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.671286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.672910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.676105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.676392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.676881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.677268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.678053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.679782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.681475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.681754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.682029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.686500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.686799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.687078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.689395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.690982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.694203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.694486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.694760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.695054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.695207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.695361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.695598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.695867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.696132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.696415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.696704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.696980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.697243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.697514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.697777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.698054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.698312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.698571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.704345 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.704636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.704929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.713500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:59:42.713775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.714050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.714317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.714580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.714856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.715120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.715395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.715657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.715915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.716174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.716440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.716717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.716980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:59:42.738490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bbcb7f9c0 pid: 80056 (default app) May 10 02:59:42.741861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c221-105e-4449-b6b9-362ef38b8045 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.742195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c221-105e-4449-b6b9-362ef38b8045 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.742482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c221-105e-4449-b6b9-362ef38b8045 None None] PATH_INFO: `/v3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.748991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:42.755991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bbcb7f9c0 pid: 80057 (default app) May 10 02:59:50.697975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.698544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.698544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.699853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 02:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:50.708735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.709197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.709292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.740338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG oslo_db.sqlalchemy.engines [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:59:50.928287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80057) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 02:59:50.928763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80057) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 02:59:50.986142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:50.987663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:51.113899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 02:59:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 02:59:51.281538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.315378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG oslo_db.sqlalchemy.engines [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:59:51.441280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6203a-0dcb-4999-b508-d8bc9f57d7a9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.445631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.446280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.446559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.446830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.454659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.506452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING keystone.common.rbac_enforcer.enforcer [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 02:59:51.506785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15161294-60dc-4daf-8a39-50200e22796a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.517263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 02:59:51.523450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.537982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7f7c-ff8f-4171-b3b7-f793ade1d07b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.542810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.544048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.544329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.544607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] PATH_INFO: `/v3/projects/2e1554fd89594f468faedf42d5357b2f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.546133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] RBAC: Authorizing `identity:get_project(project_id=2e1554fd89594f468faedf42d5357b2f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.595837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING keystone.common.rbac_enforcer.enforcer [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 02:59:51.596171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2f5b-ad6b-4277-a91a-20cf97bdf463 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.600698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 2/5] 10.222.0.55 () {56 vars in 1207 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/projects/2e1554fd89594f468faedf42d5357b2f => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.831557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861bd-e698-4bad-8315-4172dafd249b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.832107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861bd-e698-4bad-8315-4172dafd249b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.832107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861bd-e698-4bad-8315-4172dafd249b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.836385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 4/6] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 02:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:53.842393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.842766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.842941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.862510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:53.864001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:53.872235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 02:59:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 02:59:53.894401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac861bd-e698-4bad-8315-4172dafd249b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.906594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac861bd-e698-4bad-8315-4172dafd249b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.910669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.911298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.911578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.911851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.919220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.920997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71c155-b2fa-4d30-b27b-e6278fbd1b9b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.929859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 02:59:53.934964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.943658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a14e-e08d-4bfd-845b-0a4aa76f8fb3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.948524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.949404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.949680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.949946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.951319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.953155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32155e-7199-450d-b94c-f80fb07b01a9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.954690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 4/9] 10.222.0.55 () {56 vars in 1198 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:56.238729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15497-c49a-42b2-ba87-43c6be2a5e66 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.239296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15497-c49a-42b2-ba87-43c6be2a5e66 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.239296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15497-c49a-42b2-ba87-43c6be2a5e66 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.240600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 02:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:56.244355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76ccb-b75c-426e-94e5-22cc1b044e0c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.244827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76ccb-b75c-426e-94e5-22cc1b044e0c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.244932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76ccb-b75c-426e-94e5-22cc1b044e0c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.245514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.245797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.246073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.246273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 5/11] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 02:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:56.251267 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.251554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.251828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.287578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG passlib.handlers.bcrypt [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80056) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 02:59:56.287999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG passlib.handlers.bcrypt [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80056) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 02:59:56.335668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:56.337415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:56.376479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:56.377687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:56.448638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 7/12] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 02:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:56.450218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 6/13] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 02:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:56.470985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.471139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.565660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263323b1-a641-467f-a227-067a18cb5a49 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.566377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e226957-f9d4-4419-a3b4-98075b05a66e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.596735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.597384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.597698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.597979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.598073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.598248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.598346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.598554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.610103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:56.621811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:56.622920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:56.623785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 02:59:56.624786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 8/14] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:56.628585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.664147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.665836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.722192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3373-41c9-45b8-a95a-7cc68a08a522 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.761163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 7/15] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:56.767217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.863680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.864258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.864545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.864849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.865596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:56.865905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.867893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.868980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d53508-1b5b-46ec-92cd-76394318aedc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.879310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 9/16] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:56.885542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.903709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.904509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.904823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.905100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.916556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 02:59:56.937648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:56.938549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:56.939356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 02:59:56.939356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 02:59:56.939356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:56.939356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 02:59:56.939356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 8/17] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:56.946130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.979060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf64d5-7336-46f1-8f65-8da43715fe76 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:57.011110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:57.011977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:57.012258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:57.012533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:57.014065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:57.015495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:57.017128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:57.022407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:57.043497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243aed0-ab30-423b-9469-4e861b4cf3d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:57.076048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:57.076740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:57.077026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:57.077301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:57.078021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:57.078325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:57.079700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:57.096251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:57.121999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c458-c3c1-407e-93f8-01590202ade0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:57.158606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:57.159428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:57.159714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:57.159989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:57.161322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:57.162808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6eaf0a-d1e5-4c52-ad2e-c45283e9a547 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:57.165128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 02:59:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:57.171064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:57.270938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac973-7ef0-4a04-b50b-eded14649bec None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:57.304521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:57.305208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:57.305487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:57.305763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:57.306595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.domain.id=default, user.id=d17410a7e6f74e8cbdb88de8e641816d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:57.306895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:57.308339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c348-c068-48cd-87c6-f6d066943d0c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:57.314923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 10 02:59:57 2022] GET /identity/v3/role_assignments?user.id=d17410a7e6f74e8cbdb88de8e641816d&scope.domain.id=default&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:59.647402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670498e-e15c-483a-8283-8339cfa389d0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.649040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670498e-e15c-483a-8283-8339cfa389d0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.649524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670498e-e15c-483a-8283-8339cfa389d0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.651085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 02:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:59.662502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.664025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.664450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.688940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:59.690163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:59.772810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 02:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:59.810581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670498e-e15c-483a-8283-8339cfa389d0 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.934536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670498e-e15c-483a-8283-8339cfa389d0 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:59.983012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:59.984239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.984779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.985250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.010445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.012243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d4398cbe-cea2-4668-9bf8-82d34d326b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:00.035800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:00.036676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:00.037488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:00.037488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:00.037488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:00.037488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:00.040227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 13/24] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:00.045716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.058046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8639-3189-411b-b4a6-7c51da14f363 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.058654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8639-3189-411b-b4a6-7c51da14f363 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.059139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8639-3189-411b-b4a6-7c51da14f363 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.060745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 14/25] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:00.066257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.066763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.067233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.086743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:00.088309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:00.157799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 15/26] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:00.180869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.236946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b72d-9b86-4503-8f77-468cab933630 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.282208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67baa9-87da-479e-975c-e86419fdfad9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.302760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.303438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.303881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.305245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.306025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:00.306338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.307751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d275e-60db-4782-95ac-757a7014eb9a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.317886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.318707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.318988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.319258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.321526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 12/27] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:00.322914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26e9-8e98-43a0-a0e1-0b157d92ba40 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.323206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26e9-8e98-43a0-a0e1-0b157d92ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.323487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26e9-8e98-43a0-a0e1-0b157d92ba40 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.329872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 13/28] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:00.330733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef26e9-8e98-43a0-a0e1-0b157d92ba40 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.331399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-79c78b0f-ccd9-4108-af99-14bc9c7f299a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:00.340159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:00.342245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 16/29] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:00.344343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.346074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.348306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.389043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:00.390298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:00.492942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef26e9-8e98-43a0-a0e1-0b157d92ba40 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.526519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 17/30] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:00.527429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.572524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.573509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.573799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.574076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.574966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.577044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594701e5-fe72-4d5a-b4db-9df388d14da8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.714043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f89845-a216-4000-b9fc-86902ad42e0c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.756560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.757871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.758156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.758433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.759187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:00.759497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.760963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.769268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 14/32] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:00:00 2022] POST /identity/v3/projects => generated 301 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:00.769724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 18/32] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:00.770193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.771697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584d33-b751-491c-8eb5-d8a100988cca None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.772186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584d33-b751-491c-8eb5-d8a100988cca None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.773383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584d33-b751-491c-8eb5-d8a100988cca None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.775247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 15/33] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:00.776243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584d33-b751-491c-8eb5-d8a100988cca None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.901198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584d33-b751-491c-8eb5-d8a100988cca None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.969446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b427-34a4-421f-bd49-1ffd26fed512 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.986475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.987390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.987684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.987941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.993592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.995240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6d5a6-94c7-41c3-8e86-211d18609564 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.997352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 16/34] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:00.998931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.999075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.999303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.011348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.012340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.012846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.013413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.014220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.016197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6b08b-e485-49ef-9e37-72b390e7d0c7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.030227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:01.031886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:01.113690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 17/35] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:01.114553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.154037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 19/36] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 10 03:00:00 2022] POST /identity/v3/roles => generated 219 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:01.155559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39019-4897-432a-b547-52c0ede3c32d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.156014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39019-4897-432a-b547-52c0ede3c32d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.156432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39019-4897-432a-b547-52c0ede3c32d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.158164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 20/37] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:01.159073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e39019-4897-432a-b547-52c0ede3c32d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.227283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eb9bb-f5b3-40e4-ae34-dd9ceaff3a8e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.267319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.268353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.268824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.269249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.270514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e39019-4897-432a-b547-52c0ede3c32d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.270678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.272173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72afed3-2243-41d6-9b02-9fa71f790dea None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.274957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 18/38] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.276472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.276928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.277377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.301461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:01.304481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:01.308226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.309648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.309648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.309648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.310305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.311820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.327439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 21/39] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/roles => generated 225 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:01.328125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.389428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 19/40] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:01.414439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.443721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bda22-340f-4026-8ee3-2c00e4547469 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.482210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.483108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.483399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.483674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] PATH_INFO: `/v3/domains/default/users/d17410a7e6f74e8cbdb88de8e641816d/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.486045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d17410a7e6f74e8cbdb88de8e641816d, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.487547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b4f0-c6dc-40e0-afcc-1be5946baa00 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.507542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 22/41] 10.222.0.55 () {58 vars in 1361 bytes} [Tue May 10 03:00:01 2022] PUT /identity/v3/domains/default/users/d17410a7e6f74e8cbdb88de8e641816d/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:01.541499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3ecc0-729e-49e3-abba-eeaed635d5eb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.582327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.583033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.583323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.583606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.584406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.587078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675287-fada-4e4e-b7ea-077d59049f7e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.605447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 20/42] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:01.709365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417eccf-1a1f-4f3b-b609-44bceb19e063 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.709760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417eccf-1a1f-4f3b-b609-44bceb19e063 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.709978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417eccf-1a1f-4f3b-b609-44bceb19e063 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.711881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 23/43] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:01.717944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.718252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.718523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.736008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:01.737269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:01.808043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 21/44] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:01.831300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417eccf-1a1f-4f3b-b609-44bceb19e063 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.932078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417eccf-1a1f-4f3b-b609-44bceb19e063 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.964411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.965232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.965520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.965798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.966972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.968427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d52ede-fd9e-490e-8adf-9bc1cabfbe44 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.970080 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 24/45] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.975561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.070514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166129b-b327-485f-b0d4-b6177de4c349 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.102907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.103571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.103858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.104138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.104890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.106346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cdbf-603e-486f-8af1-2684e707ceb5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.131009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 22/46] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/projects => generated 312 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:03.771035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4162e-559a-4e8d-b576-3213b727a1e3 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.771556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4162e-559a-4e8d-b576-3213b727a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.771662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4162e-559a-4e8d-b576-3213b727a1e3 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.773616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 25/47] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:03.779309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.779709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.779983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.797133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:03.798319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:03.868578 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 23/48] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:03.891032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4162e-559a-4e8d-b576-3213b727a1e3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.988391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4162e-559a-4e8d-b576-3213b727a1e3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.020135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.020955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.021296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.021525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.032093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:04.039727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:04.040617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:04.041437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 26/49] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:04.046681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.141220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0c23e-306d-49f0-9a17-1be614cddabe None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.175509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.176208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.176492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.176802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.177580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:04.177889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.180106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.192769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 24/50] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:04.199020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.294326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d3376-7d4d-4e8f-820a-6e8fa4efe33c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.326010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.326874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.327157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.327431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.328635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.330098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdc34-fec9-4cf1-be05-75dbbd94808d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.331711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 27/51] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:04.337197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.362677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16782-2450-4d94-927e-d894210a7323 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.362969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16782-2450-4d94-927e-d894210a7323 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.363252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16782-2450-4d94-927e-d894210a7323 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.364614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 28/52] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:04.370280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.370575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.370853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.387204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:04.388753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:04.436432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe83d1f-0be6-41e4-9513-83d95605ffa7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.451656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 29/53] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:04.468211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.469027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.469311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.469582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.470742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.472180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.474040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 25/54] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:04.474945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.479912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.567506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653bf6-06c0-4461-9788-7f18b5e7374a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.571456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b730796-0361-4f5d-aef2-d5b71b3327bc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.598961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.599736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.600016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.600285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.601675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.602608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.603105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.603544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.603826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.604100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.604723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 30/55] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:04.604962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.domain.id=default, user.id=d17410a7e6f74e8cbdb88de8e641816d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:04.605269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.606676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61fa3-0596-4537-9966-870d800d78c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.610240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.612472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 26/56] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/role_assignments?user.id=d17410a7e6f74e8cbdb88de8e641816d&scope.domain.id=default&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 530 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:04.713127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a32f7-f845-4d70-9388-403767055ed3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.747859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.748539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.748859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.749129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.749866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.751325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0220-8fda-4bf3-b5ab-21c27722de8c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.779558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 31/57] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 10 03:00:04 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:07.008352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978905-b281-45d1-bd45-545c877a84d0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.008944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978905-b281-45d1-bd45-545c877a84d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.008944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978905-b281-45d1-bd45-545c877a84d0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.010326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 27/58] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:07.015441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.015849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.015999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.033177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:07.034370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:07.097143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 32/59] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:07.120981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86978905-b281-45d1-bd45-545c877a84d0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.216761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86978905-b281-45d1-bd45-545c877a84d0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.248304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.249110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.249396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.249672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.250837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.252288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d80f2-33ce-4e68-af65-0b9ac68ad03e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.253927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 28/60] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:07.259920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.353381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bd6fe-2c07-4e82-937c-69aeb22d7e7a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.385441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.386092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.386374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.386649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.387357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.388822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a6c3-4173-4513-ada0-daaf8ff1eeb0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.414182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 33/61] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:07 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:10.628122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815bdc-edb0-4427-8817-76b246008a23 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.629154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815bdc-edb0-4427-8817-76b246008a23 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.629667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815bdc-edb0-4427-8817-76b246008a23 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.631239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 29/62] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:10.637192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.638052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.638709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.665710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:10.666921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:10.754026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 34/63] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:10.802541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815bdc-edb0-4427-8817-76b246008a23 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.926739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815bdc-edb0-4427-8817-76b246008a23 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.972684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.973502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.973783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.974056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.999465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bf722fd9-1160-4377-a742-e3fc49d0dcba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.014661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:11.016869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 30/64] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:11.021801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.131204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7257c5-8e38-4a3c-8a06-66ffc1b42da2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.132395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7257c5-8e38-4a3c-8a06-66ffc1b42da2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.133062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7257c5-8e38-4a3c-8a06-66ffc1b42da2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.134937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 31/65] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:11.140029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128cd2b-5601-4f97-b6e1-5acbe47b413a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.140544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128cd2b-5601-4f97-b6e1-5acbe47b413a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.141033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128cd2b-5601-4f97-b6e1-5acbe47b413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.155755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28a63-63ac-434a-9e1c-fc50525590c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.178841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9128cd2b-5601-4f97-b6e1-5acbe47b413a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:11.178841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9128cd2b-5601-4f97-b6e1-5acbe47b413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:11.190692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.191378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.191664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.191944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.192790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.193097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.194726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0169-8be3-4270-8eae-4b4b76e7a6e1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.204103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 35/66] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.205603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9ac0-f3ff-4cd2-8f2a-dae0c418903d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.205963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9ac0-f3ff-4cd2-8f2a-dae0c418903d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.206248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9ac0-f3ff-4cd2-8f2a-dae0c418903d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.207617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 36/67] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:11.213494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9ac0-f3ff-4cd2-8f2a-dae0c418903d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.254274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 32/68] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:11.255895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9c78-713e-44dc-ae40-d47d6dd237d7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.256392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9c78-713e-44dc-ae40-d47d6dd237d7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.256896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9c78-713e-44dc-ae40-d47d6dd237d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.277570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ddfc9c78-713e-44dc-ae40-d47d6dd237d7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:11.279877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ddfc9c78-713e-44dc-ae40-d47d6dd237d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:11.316590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9ac0-f3ff-4cd2-8f2a-dae0c418903d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.346128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 33/69] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:11.347727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316723-ec6a-4001-aa8d-80a83b2a472e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.348072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316723-ec6a-4001-aa8d-80a83b2a472e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.348354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5316723-ec6a-4001-aa8d-80a83b2a472e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.352782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 34/70] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:11.353742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5316723-ec6a-4001-aa8d-80a83b2a472e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.361057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.362188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.362702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.363149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.379401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.380889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f40ceb-562f-4695-ad7b-71c1a104bdf5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.387544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 37/71] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.388751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.389213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.389500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.406673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:11.407924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:11.454737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5316723-ec6a-4001-aa8d-80a83b2a472e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.470369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 38/72] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:11.471185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.498107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.498911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.499191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.499469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.509687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.517704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.518556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:11.519306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 35/73] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:11.519938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.564619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcac92b-934e-4316-ac69-cb9e1946e029 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.597775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.598562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.598842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.599142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.608831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.611933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc478c-e252-42cf-ba13-677ff578d76e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-7a97c789-fffb-45de-9f9a-f3131c26f238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.616346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.617258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:11.618013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 39/74] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:11.618973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8a57-d0eb-4c02-ae42-77fb875675b4 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.618973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8a57-d0eb-4c02-ae42-77fb875675b4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.619329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8a57-d0eb-4c02-ae42-77fb875675b4 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.620668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 40/75] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:11.622276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8a57-d0eb-4c02-ae42-77fb875675b4 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.646545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.647794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.648078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.648354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.712272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.713696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.717125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8a57-d0eb-4c02-ae42-77fb875675b4 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.748079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.748885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.749165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.749438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.759521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.767021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.767839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:11.768797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 41/76] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:11.770801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.805409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 36/77] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:11.806241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.864853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979841a9-bc58-4014-b6df-07fa3c041823 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.897333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.897997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.898276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.898549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.899288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.899564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5060e-ed3e-4c6e-bca1-798099a20718 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.899667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.900981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235e41-44bb-4ee5-a907-e37e646c89db None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.908799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 42/78] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.910039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.910327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.910606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.926005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:11.927166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:11.933126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.933797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.934102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.934366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.935117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.935424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.936828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.945652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 37/79] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.946440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.990134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 43/80] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:11.991617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.041804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66783907-77f0-40b6-b637-43e647c67a9f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.074431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.075099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.075386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.075660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.076405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:12.076737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.078130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.085018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96968cd1-efd0-45dd-9e6d-07f0afecca72 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.086007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 38/81] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.086630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.118333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.119191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.119474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.119748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.120960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.122397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.124088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 44/82] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.124872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.180424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f8bfc-7014-483d-8cfc-cfe7dba7e37e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.211913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.212817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.213100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.213373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.214556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.215990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.217641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 39/83] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.218399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.220585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf02e-ec80-4809-bfe7-fd1698e154f8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.254039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.254837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.255143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.255420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.257660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.259117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.260768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 45/84] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.261529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.313475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a9825-42fc-4135-a2d7-0b49e4e7246f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.345266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.346055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.346338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.346604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.347745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.349210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.350843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 40/85] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.355556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.355655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1cc87-768b-4d5b-9c6f-30bd59098e2f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.386883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.387739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.388019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.388289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.389489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.390904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.392490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 46/86] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.393274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.451075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27a4e-f1b5-4a8c-9ffd-a79d7cefda98 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.483600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.484254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.484539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.484848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.485679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d141-f2ba-4bf6-ac27-7b1261d84e85 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.485770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:12.485995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.487430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.493858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 41/87] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:12.494647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.519829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.520406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.520715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.520994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.591938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.593474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.598395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb9b2-684e-48a8-84d1-2327156ed84e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.636214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.636902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.637186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.637469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.696227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 47/88] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:12.696906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.707815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.709313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.791718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a4945-8715-43bf-ab5b-2d0ca2a3c83a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.809808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 42/89] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:12.809808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.825475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.826145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.826426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.826704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.827418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.828881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.849189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 48/90] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:12 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:12.851197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.911315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbfe1a-ccda-40c8-9261-172bedc5fb29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.948566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.949270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.949555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.949830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.964567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8881f-f26e-4428-af75-62ba37a6b9aa None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.001901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.003128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.003648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.004125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.005686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.008003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.010072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 49/91] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:13.011062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:13.029096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.030606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.139263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2b44-e09e-4659-a857-97a2b7d65e21 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.153430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 43/92] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:13.154284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:13.188290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.189194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.189480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.189754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.191993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.193670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.195955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 50/93] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:13 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:13.196785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:13.275706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6626ea3-ddbf-46d0-8e17-12839d7eeac7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.328097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0db5-3fe8-4230-90e7-c5924a76be78 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.331661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.332330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.332614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.332944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.333782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:13.334100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.337006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.345387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 44/94] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:13 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:13.346269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:13.400074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.400984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.401262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.401536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] PATH_INFO: `/v3/projects/e37b8c3c18854c52a0fb592c14125b3a` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.404300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] RBAC: Authorizing `identity:get_project(project_id=e37b8c3c18854c52a0fb592c14125b3a)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.405816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.407635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 51/95] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:13 2022] GET /identity/v3/projects/e37b8c3c18854c52a0fb592c14125b3a => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:13.420528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:13.554913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b734-4f3e-47ec-b3ad-00dcf4bb1247 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.605142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66de7-c291-40a4-b7b5-a336bab54e76 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:13.628241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.628936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.629216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.629491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.630332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=d17410a7e6f74e8cbdb88de8e641816d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:13.630642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.633477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefc184-9e51-4278-8865-0137525d6d8a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.647875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 45/96] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:13 2022] GET /identity/v3/role_assignments?user.id=d17410a7e6f74e8cbdb88de8e641816d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:13.658949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:13.659635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:13.659920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:13.660198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:13.661171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=e37b8c3c18854c52a0fb592c14125b3a, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:13.661485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:13.663081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb64ba-bc1c-4931-a5d0-ba06182f5c2e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:13.672157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 52/97] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:13 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=e37b8c3c18854c52a0fb592c14125b3a&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:15.247731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5558ab-038c-4630-9b38-b7b7de9e73ec None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.248574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5558ab-038c-4630-9b38-b7b7de9e73ec None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.249023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5558ab-038c-4630-9b38-b7b7de9e73ec None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.250882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 46/98] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:15.256060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.257914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.258339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.279408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:15.280946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:15.368010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 53/99] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:15.401845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5558ab-038c-4630-9b38-b7b7de9e73ec None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.530293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5558ab-038c-4630-9b38-b7b7de9e73ec None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.576088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.577185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.577613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.578030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.593447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:15.602487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:15.603530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:15.604480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:15.610671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 47/100] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:15.617576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.720034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8f4df-277a-47da-9b19-6f739b24d3ed None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.760502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.761254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.761507 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.761780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.762539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:15.762843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.764220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.775474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 54/101] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:15.781360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.904491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0cc1-8367-45bb-aaf4-a39a285ad893 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.948143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.949450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.950006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.950493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.951931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.953630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.955802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 48/102] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:15.961892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.112094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc9722-9d28-4bd4-8a57-1084fa6ec4b1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.157211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.158078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.158359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.158629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.159833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.161310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503a459-6b32-42d9-ba7d-f3b6c7bf3feb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.163359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 55/103] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:16.169223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.274305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fc96b-3b88-4a91-9db9-a2a6e08b186d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.274813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fc96b-3b88-4a91-9db9-a2a6e08b186d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.274813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fc96b-3b88-4a91-9db9-a2a6e08b186d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.276242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 56/104] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:16.281486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bf0a-fd0e-4368-a2b9-3c6546e479b6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.290099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.290397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.290657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.324540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.325841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.326173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:16.326544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.327018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/7bbedd417be842a191a1377eebc6eb1f/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.327380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:16.333524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, user_id=7bbedd417be842a191a1377eebc6eb1f, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.335833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.363899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 49/105] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:16 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/7bbedd417be842a191a1377eebc6eb1f/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:16.432188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 57/106] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:16.465760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.589630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872807-2df4-4f6c-95bb-806b41c44ee9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.635604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.636846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.637352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.637880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.655175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bb716682-9ba4-4da2-a3bd-8c80ac9951f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:16.663557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:16.664454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:16.665286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:16.667727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 50/107] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:16.677853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.816280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b35f94-a3a4-4335-a4d4-fc794c2d77bf None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.834036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563921-594e-46c0-9800-d17f584df5f3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.834036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563921-594e-46c0-9800-d17f584df5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.834036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563921-594e-46c0-9800-d17f584df5f3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.834036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 51/108] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:16.841802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d41a-2939-42e6-91b1-6c3231130804 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.842341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d41a-2939-42e6-91b1-6c3231130804 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.842835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d41a-2939-42e6-91b1-6c3231130804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.863453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ef98d41a-2939-42e6-91b1-6c3231130804 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:16.865055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef98d41a-2939-42e6-91b1-6c3231130804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:16.865162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.865828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.866110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.866384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.867136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:16.867443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.868860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.884575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 58/109] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:16.890097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.953845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 52/110] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:16.954811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac899-fe3e-4c83-8c6d-f3d40c9abb42 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.955099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac899-fe3e-4c83-8c6d-f3d40c9abb42 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.955376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac899-fe3e-4c83-8c6d-f3d40c9abb42 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.956699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 53/111] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:16.962741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.963287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.963778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.994505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:16.997022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:17.069354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f886f-4596-4e9c-8661-d365556cea13 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.093297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 54/112] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:17.099560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.124155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.125511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.126435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.126916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] PATH_INFO: `/v3/users/80c3f48fd0344741b3e116bdf330246f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.145052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] RBAC: Authorizing `identity:get_user(user_id=80c3f48fd0344741b3e116bdf330246f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.147426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d3293-688a-4fb2-a941-b58076223586 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.150289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 59/113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/users/80c3f48fd0344741b3e116bdf330246f => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:17.151786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7cd0-9969-4de3-b79d-b06e0053a7ba None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.152354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7cd0-9969-4de3-b79d-b06e0053a7ba None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.152855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7cd0-9969-4de3-b79d-b06e0053a7ba None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.154857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 60/114] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:17.156160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7cd0-9969-4de3-b79d-b06e0053a7ba None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.219445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9d24-4d6a-4fee-bb06-c409ca5cbc22 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.256141 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.257690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.258014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.258273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.260867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7cd0-9969-4de3-b79d-b06e0053a7ba None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.268230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:17.276524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:17.277438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:17.278489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 55/115] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:17.279117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.298520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.299316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.299595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.299866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.310670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9a4dc8f5-0153-4b40-be4f-d1ab8a441829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:17.318262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:17.319706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 61/116] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:17.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3373-3545-4f24-ab86-13ebbaa27c3c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.326322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3373-3545-4f24-ab86-13ebbaa27c3c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.326322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3373-3545-4f24-ab86-13ebbaa27c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.341756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e2dc3373-3545-4f24-ab86-13ebbaa27c3c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:17.343058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e2dc3373-3545-4f24-ab86-13ebbaa27c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:17.384306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942af9b-9d2e-4fd7-b693-7d600d492451 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.409967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 62/117] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:17.411611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bad02-c94e-4410-a137-fcea7c9c58ae None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.411855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bad02-c94e-4410-a137-fcea7c9c58ae None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.412138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bad02-c94e-4410-a137-fcea7c9c58ae None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.417738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 63/118] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:17.417738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bad02-c94e-4410-a137-fcea7c9c58ae None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.439208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.439208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.439208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.439208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.501208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.502691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe87ed-0040-412e-a899-e3493b437843 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.522552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bad02-c94e-4410-a137-fcea7c9c58ae None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.557470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.558404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.558705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.558980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.559720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:17.560023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.561424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.569928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 64/119] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:17.571336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.601462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 56/120] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:17.602778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.603065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.603342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.619084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:17.620273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:17.672895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a04d3-37e0-48ef-bd67-a39e9c6676bc None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.684329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 57/121] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:17.685203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.706237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.707217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.707690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.708213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.709351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:17.710743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.712310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.720338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 65/122] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:17.721374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.794740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e177-da19-460f-95a0-04986bf570cb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.822902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfeeb1-e5e5-41eb-8ac2-c90ec5ad8e24 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.827079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.827872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.828151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.828422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.829610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.831060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.833029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 58/123] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:17.833765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.858827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.859695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.859973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.860243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.861450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.862874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.864628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 66/124] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:17.865288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.939411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ed46-ac9e-488f-9118-e5bfd565e895 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.965472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa510-d7f4-4497-9bce-1e537800f619 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.976814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.978058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.978845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.979366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.980730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.982320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.984173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 59/125] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:17.985109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.001707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.002505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.002949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.003230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.013829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:18.021449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:18.022452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:18.023238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 67/126] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:18.024384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.092184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db465d28-d61b-4167-bb6c-21d324ac9032 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.129047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177020c3-afc3-4e51-842e-7aa02e239b0c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.129481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.130344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.130623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.130894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.132843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.134292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.136079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 60/127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.137471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.165116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.166122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.166646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.167003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.167716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.169178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.195490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 68/128] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:00:18 2022] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:18.196354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.259115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdbb86-1cdf-4db1-962f-c8bcdd3304de None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.298395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.299319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.299606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.299917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.301459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.303063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.305201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 61/129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.305937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.323863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2ac9-861c-41ad-9769-e8d60a5778d7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.363429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.364433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.365052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.365571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.366906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=80c3f48fd0344741b3e116bdf330246f) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:18.367424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.369268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.376077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 69/130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/role_assignments?user.id=80c3f48fd0344741b3e116bdf330246f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.377352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.421114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13038-a07c-4a66-9d14-c6efc022650f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.459097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.459835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.460124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.460405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.461573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:18.461573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.463096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.472508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 62/131] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.473184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.490568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ca7b5-061c-41b7-9acd-d2821a032aae None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.528828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.530063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.530549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.531038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] PATH_INFO: `/v3/projects/e37b8c3c18854c52a0fb592c14125b3a` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.532508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e37b8c3c18854c52a0fb592c14125b3a)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.534249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.536335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 70/132] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/projects/e37b8c3c18854c52a0fb592c14125b3a => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.537893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.590090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf55c-4212-4a81-a5ad-91cb57540856 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.627540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.628445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.628772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.629046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/7bbedd417be842a191a1377eebc6eb1f/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.631305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, user_id=7bbedd417be842a191a1377eebc6eb1f, role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.632790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.649944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766331d-4088-4b01-8bdf-a3b053f1a7b4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.651332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 63/133] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:18 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/7bbedd417be842a191a1377eebc6eb1f/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:18.652769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.719766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.720579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.720882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.721155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.726222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.727700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.729420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 71/134] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.736112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.836979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa43b-4753-40b7-9a50-289043002741 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.916917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.917893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.918182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.918458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] PATH_INFO: `/v3/projects/e37b8c3c18854c52a0fb592c14125b3a/users/7bbedd417be842a191a1377eebc6eb1f/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.925674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] RBAC: Authorizing `identity:create_grant(project_id=e37b8c3c18854c52a0fb592c14125b3a, user_id=7bbedd417be842a191a1377eebc6eb1f, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:18.927233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:18.956382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 64/135] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:18 2022] PUT /identity/v3/projects/e37b8c3c18854c52a0fb592c14125b3a/users/7bbedd417be842a191a1377eebc6eb1f/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:18.973030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1b8b-a8e8-4fbb-9082-b5a51cc1c400 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.011171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.012414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.012943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.013453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.014944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.016636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bfea-1d59-463d-843e-b43268150eaf None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.018697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 72/136] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:19.024898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.180517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb137f-7e4b-4c37-9574-59db2a10a5aa None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.180883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb137f-7e4b-4c37-9574-59db2a10a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.181117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb137f-7e4b-4c37-9574-59db2a10a5aa None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.182531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 73/137] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:19.196826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced325-0514-4610-8a7a-99c4d878cc06 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.202431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.202729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.202998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.237793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:19.238943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:19.257527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.258462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.258743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.259019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/d17410a7e6f74e8cbdb88de8e641816d/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.261203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, user_id=d17410a7e6f74e8cbdb88de8e641816d, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.262691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.291811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 65/138] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:19 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/d17410a7e6f74e8cbdb88de8e641816d/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:19.342075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 74/139] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:19.366541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.486179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89c98-f712-48a5-9d8b-4c909f37c471 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.526584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.527304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.527588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.527863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.539574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:19.547307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:19.549361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:19.551231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 66/140] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:19.556674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.655626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d9f5b-64cf-49b2-b690-e956a68356cf None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.690318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.690994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.691279 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.691557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.692305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:19.692613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.694296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.702630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 75/141] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:19.708228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.811124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b607-ab37-43a8-a7ec-c43f52ac7302 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.845039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.845924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.846206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.846480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.847687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.849177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.850842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 67/142] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:19.856422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.956361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dc6f-e8ce-4389-ab9a-4581ff9f8e26 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.990848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.991723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.992013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.992289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.061975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.064687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.170064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 76/143] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:20.171456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.273005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaef2-c33a-4329-bf53-d9f75c030912 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.307684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.308554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.308870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.309153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.310412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.311911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49da3f-8621-4f20-9f3e-bbaa3622d0eb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.313585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 68/144] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:20.319783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.420735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363ca7e-0d13-4086-ab21-c68f1aed08bb None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.453956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.454620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.454902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.455175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.456063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:20.456425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.457960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcbd30-5e9b-45bd-ade8-3835d3bfddfd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.464536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 77/145] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.553954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfd75-de8e-44d6-894f-313b2b38d487 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.554511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfd75-de8e-44d6-894f-313b2b38d487 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.554511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfd75-de8e-44d6-894f-313b2b38d487 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.555660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 69/146] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:21.560921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560435a-af7c-4423-8e4a-42a99d75b5ba None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.561315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560435a-af7c-4423-8e4a-42a99d75b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.561498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560435a-af7c-4423-8e4a-42a99d75b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.577947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5560435a-af7c-4423-8e4a-42a99d75b5ba None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:21.579101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5560435a-af7c-4423-8e4a-42a99d75b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:21.674932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 78/147] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:21.711826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfd75-de8e-44d6-894f-313b2b38d487 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.842437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfd75-de8e-44d6-894f-313b2b38d487 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.882508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.883309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.883602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.883861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.885059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.886497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.888111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 70/148] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.891663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c78d2-01fb-4576-9023-792328352556 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.891955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c78d2-01fb-4576-9023-792328352556 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.892247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c78d2-01fb-4576-9023-792328352556 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.893630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 79/149] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:21.897981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.902405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f50c-a0a3-42fc-ab1d-e2951a89371f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.902946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f50c-a0a3-42fc-ab1d-e2951a89371f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.903726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f50c-a0a3-42fc-ab1d-e2951a89371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.933657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-22e6f50c-a0a3-42fc-ab1d-e2951a89371f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:21.935214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-22e6f50c-a0a3-42fc-ab1d-e2951a89371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:22.012691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f3d6-4551-45cd-867e-13995cdcc272 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.054925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 80/150] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:22.060787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.063821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.063821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.063821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.064047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c840b-b3a1-424c-9b37-0494a63b58a4 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.064047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c840b-b3a1-424c-9b37-0494a63b58a4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.064186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.064259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c840b-b3a1-424c-9b37-0494a63b58a4 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.064325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.064388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 81/151] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:22.074341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.074628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.074902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.101380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 71/152] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:21 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:22.101962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:22.102185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.103126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:22.227790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737526-753a-4a20-89a9-72130234f5c3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.262933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 82/153] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:22.273051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.273961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.274254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.274533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.289775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:22.304723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.305675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:22.306449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:22.310506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 72/154] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.313897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.317192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.435510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c1e8b-5d85-4e2f-bc27-c3bae1fd6642 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.444604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02341d79-515a-428e-9469-87fa521ee6e2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.481700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.482385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.482664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.482935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.483687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.483992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.485453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c689-349e-41b0-a6c4-1f52a8237af5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.490907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.492186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.492468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.493316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.494132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 83/155] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.495749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85985-86fa-4c37-8ae2-c69cbf7e29c9 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.495855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85985-86fa-4c37-8ae2-c69cbf7e29c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.496075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85985-86fa-4c37-8ae2-c69cbf7e29c9 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.497568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 84/156] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:22.502537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f85985-86fa-4c37-8ae2-c69cbf7e29c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.503842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f88a989c-340b-436b-8390-9f3c48841baa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:22.511967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.512883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:22.513644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 73/157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.519079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.519376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.519883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.540558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:22.541513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:22.618819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 74/158] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:22.618819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.634778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f85985-86fa-4c37-8ae2-c69cbf7e29c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.680948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.681907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.682198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.682472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.684441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.687154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c1065-d1be-47b2-98c4-c0c9a770c470 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.688884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 85/159] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:22.690115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4af36-6fb6-4575-a0bd-75d4fd22f096 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.690400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4af36-6fb6-4575-a0bd-75d4fd22f096 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.690674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4af36-6fb6-4575-a0bd-75d4fd22f096 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.692199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 86/160] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:22.692939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4af36-6fb6-4575-a0bd-75d4fd22f096 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.738538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374f84-a887-4c92-9b4e-a54a926b5004 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.782128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.782807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.783091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.783365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.784305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.785411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.786848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.800773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 75/161] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.801705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.821497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4af36-6fb6-4575-a0bd-75d4fd22f096 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.864949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.866465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.866972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.867438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.878891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-b95a60c4-e2ec-45c0-9423-c922cd59046f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:22.887818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.888965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:22.889810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:22.892223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 87/162] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.893700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.894184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.894717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.912779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:22.914345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:22.921496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f03b0-01d6-4607-ad05-ceef9128c9bd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.968234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.969308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.969815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.970282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.013277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 88/163] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:23.014457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.085883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.087395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.185208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afcda3-f5c4-4982-9d3b-7b1d4596000f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.218787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.219582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.219856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.220123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] PATH_INFO: `/v3/users/80c3f48fd0344741b3e116bdf330246f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.221379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=80c3f48fd0344741b3e116bdf330246f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.222823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.224442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 89/164] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/users/80c3f48fd0344741b3e116bdf330246f => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.226567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.301249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 76/165] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:23.302418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.338422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3be42a-fd55-4112-866e-5b24dc4e5ec7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.384593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.385289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.385566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.385835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.386577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.386878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.388239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.397219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 90/166] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.398991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.508561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ae93-b687-4d1f-b225-dace9c3eabf3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.545129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.546129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.546426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.546701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.547890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.549785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.551698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 91/167] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.552608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.561548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450fc1-8425-4c45-852a-9fd1de90da7e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.606240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.607042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.607321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.607600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.629642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:23.637897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:23.638767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:23.639533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 77/168] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:23.640695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.654781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390071f-8534-41d7-9106-f6d3c8f88a4d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.689547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.690407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.690738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.691009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.692168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.693711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.695414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 92/169] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.696157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.761519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84749d-8266-4e46-bb12-a07294a0bd8e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.795421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e324a-6278-4369-951d-c90f3d921e99 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.810102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.810998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.811276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.811552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] PATH_INFO: `/v3/users/7bbedd417be842a191a1377eebc6eb1f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.816687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbedd417be842a191a1377eebc6eb1f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.816687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.817370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 78/170] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/users/7bbedd417be842a191a1377eebc6eb1f => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.818998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.832678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.833788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.833920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.834742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/80c3f48fd0344741b3e116bdf330246f/roles/613ecc5b62194fec8dba1aea94811f6c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.844738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, user_id=80c3f48fd0344741b3e116bdf330246f, role_id=613ecc5b62194fec8dba1aea94811f6c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.844738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.858807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 93/171] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:23 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/users/80c3f48fd0344741b3e116bdf330246f/roles/613ecc5b62194fec8dba1aea94811f6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:23.860817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.062686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c2e6-6c7a-4f12-996c-4e1a6742f234 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.094775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566435-5262-48fa-8bed-a06070c88593 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.138076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.138759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.139033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.139305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.140060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:24.140359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.141767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.154093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 79/172] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:24.155021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.160144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.161523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.161808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.162107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.163083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:24.163398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.164860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.171200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 94/173] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:24.172022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.265615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933509-a4c7-4b17-968f-928e498162f4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.306498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.307159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.307437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.307707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.386237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deadf4-6c15-4aed-be28-5e3b757e4a1e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.425222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.426097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.426374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.426644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] PATH_INFO: `/v3/users/d17410a7e6f74e8cbdb88de8e641816d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.428426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] RBAC: Authorizing `identity:get_user(user_id=d17410a7e6f74e8cbdb88de8e641816d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.430336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.432205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 95/174] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/users/d17410a7e6f74e8cbdb88de8e641816d => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:24.437908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.449530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.451009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.575855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f593-bc59-4fdc-a2ed-9321f79d42db None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.641354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.641930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.642207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.642478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.655881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 80/175] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:24.661147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.768951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.771064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.844972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989540a-b643-4ae1-b3af-8644b725a367 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.925429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 96/176] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:24.930375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.931261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.931536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.931809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] PATH_INFO: `/v3/projects/e37b8c3c18854c52a0fb592c14125b3a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.933061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] RBAC: Authorizing `identity:get_project(project_id=e37b8c3c18854c52a0fb592c14125b3a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.934533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.936338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.939335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 81/177] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/projects/e37b8c3c18854c52a0fb592c14125b3a => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:24.947809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.096028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590cbe3-d3a8-4a24-a9bf-14a8aafcea24 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.134927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.135673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.135953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.136223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.137080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=e37b8c3c18854c52a0fb592c14125b3a, user.id=7bbedd417be842a191a1377eebc6eb1f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.137386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.138820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779771c6-5a82-4fe8-a6fb-5c1f05301ccf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.144933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 82/178] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/role_assignments?user.id=7bbedd417be842a191a1377eebc6eb1f&scope.project.id=e37b8c3c18854c52a0fb592c14125b3a&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:25.162809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44dc2-3aec-4557-bcd4-fdb495cb3475 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.163132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44dc2-3aec-4557-bcd4-fdb495cb3475 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.163353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44dc2-3aec-4557-bcd4-fdb495cb3475 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.164825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 83/179] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:25.173897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.174232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.174439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.179724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd041-9a37-4c29-b441-a89e826b458e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.212519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:25.213738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:25.235049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.235919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.236195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.236467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.239241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.241334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.243448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 97/180] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:25.249200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.366519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 84/181] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:25.414143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.445621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22a8e9-8456-474f-ae7d-4f3757e2f84f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.483765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.484440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.484879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.485169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.486145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=d17410a7e6f74e8cbdb88de8e641816d) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.486463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.487896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfe76-f38f-45d7-8d3b-ef2e345cfb67 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.496011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 98/182] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/role_assignments?user.id=d17410a7e6f74e8cbdb88de8e641816d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:25.518811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e53-98a4-430a-a149-fb221ac3e2ee None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.519109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e53-98a4-430a-a149-fb221ac3e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.519714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e53-98a4-430a-a149-fb221ac3e2ee None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.521751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 99/183] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:25.527675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.528045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.528683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.561759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:25.563303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:25.632685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844715-878e-488d-b813-0e6e2d7b2c6f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.667488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.668359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.672700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.672700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.682176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:25.690187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:25.691143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:25.691989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 85/184] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:25.694995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 100/185] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:25.698770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.729867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.816251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71f22-f66b-4531-a277-0a67f8d5c3fa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.854040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e872-e396-4862-922f-3ea78fe0453b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.858647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.859377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.859655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.859923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.860699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.861007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.862816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.874066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 86/186] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:25.879932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.901365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.902182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.902459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.902727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.904321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.905793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.907665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 101/187] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:25.913524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.009153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a01d7-ea72-4264-9ea7-03bcd799537f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.040773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428aac-ea85-4b9e-a088-92930f1f4eee None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.048308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.049745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.050026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.050296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.067979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.070840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.073329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 87/188] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:26.078635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.082533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.083344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.083690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.084795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.085606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.087113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3986-d66c-4150-afa2-8b07409790ce None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.111267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 102/189] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:25 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:26.135556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318944-ca45-4836-83dc-b1cfe029b1c9 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.135879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318944-ca45-4836-83dc-b1cfe029b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.136115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318944-ca45-4836-83dc-b1cfe029b1c9 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.141938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 103/190] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:26.143430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.143716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.143992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.161646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:26.163078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:26.206949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af8770-e1b4-4aee-aa9d-80e32e5421cb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.235236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 104/191] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:26.249910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.250580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.250863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.251137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.260046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.336759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.338235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.379345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fe3a-bf64-491d-ac62-d3b86d047db1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.423187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.424421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.424920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.425191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.446321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:26.455286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:26.456387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:26.457292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 105/192] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:26.463178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.475915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 88/193] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:26.481843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.586734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d12f-d9d0-4a6e-9a62-3f7b420eb2fe None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.592035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b156b-efea-4e17-97db-3155c6604c81 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.620395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.621098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.621378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.621652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.622399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:26.622705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.624087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.626781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.627647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.627928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.628199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.629426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.631452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.633023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 106/194] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:26.633612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 89/195] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:26.638224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.639116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.741184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd757-c214-46c8-8e81-d0b48e82b31f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.741975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332fd7-9533-4d09-a90b-28fccd0154f2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.776018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.776924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.777047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.777224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.777463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.777625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.777888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.778558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.778926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.779450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=9d039e2de79344b3ae7862b0696346f5) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:26.779764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.780362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.781230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.782034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 107/196] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:26.788382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.789197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 90/197] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/role_assignments?user.id=9d039e2de79344b3ae7862b0696346f5&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:26.920702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d73d-e8a1-4995-b675-37de3176481f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.964573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.965269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.965557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.965834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.066182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.067672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6cdf3-e97a-422b-9e7f-eb35655feaec None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.184377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 108/198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:27.194105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.194625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ca0-ddf2-4641-ac54-db43becb5506 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.194882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ca0-ddf2-4641-ac54-db43becb5506 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.195165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ca0-ddf2-4641-ac54-db43becb5506 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.196853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 109/199] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:27.201954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.202237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.202515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.232424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:27.233667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:27.296414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3100f-d524-4511-a714-efb4f7b16a53 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.330778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.331646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.331928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.332202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.333422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.335036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.337120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 91/200] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.345644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.367101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 110/201] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:27.389618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.506313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db546-a498-47ff-9884-8c6d9ef61496 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.511130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f92c0-37b8-48fb-8a9a-a4697c7117fb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.540670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.541478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.541756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.542029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.552465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:27.560809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.561688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:27.562468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 111/202] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:27.568016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.598332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.599005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.599288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.600102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.605092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=9d039e2de79344b3ae7862b0696346f5) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.605420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.606886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.617339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 92/203] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/role_assignments?user.id=9d039e2de79344b3ae7862b0696346f5&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.699869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea77a4-bff5-4641-b580-2495187f3192 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.748236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.748941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.749221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.749494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.750241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.750544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.751925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.761524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 112/204] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:27.769799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.928336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730128f-d122-4c1e-9404-7604f73fe90d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.965991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.966902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.967184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.967462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] PATH_INFO: `/v3/users/80c3f48fd0344741b3e116bdf330246f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.968798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] RBAC: Authorizing `identity:get_user(user_id=80c3f48fd0344741b3e116bdf330246f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.970287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.972197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 93/205] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/users/80c3f48fd0344741b3e116bdf330246f => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.977591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.119324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522813-d522-44c0-905c-8a039b1def33 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.168135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.168826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.169108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.169382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.247709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.249201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.349680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 113/206] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:28.357785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.478603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf4fe-1b1c-4c69-9ca1-eacc2be466a6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.511809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.512695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.512985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.513259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.514457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.515903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734756f4-d1f7-458b-ab33-ca5fd4950d30 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.518391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 94/207] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.529767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.651289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f007f-26ef-40c9-adf8-c1a6a4869ccd None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.685800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.686457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.686733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.687051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.687885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda, user.id=80c3f48fd0344741b3e116bdf330246f) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.688192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.689660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63b13-031b-468f-9c61-ef30d4d254f8 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.696318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 114/208] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/role_assignments?user.id=80c3f48fd0344741b3e116bdf330246f&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.016237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ad51-bd35-4852-a7d6-1cc724fb9d84 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.016237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ad51-bd35-4852-a7d6-1cc724fb9d84 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.016237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ad51-bd35-4852-a7d6-1cc724fb9d84 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.016237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 95/209] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:29.022837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85e7-3790-48e3-b646-732b5352c426 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.023321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85e7-3790-48e3-b646-732b5352c426 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.023485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85e7-3790-48e3-b646-732b5352c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.052376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4ccb85e7-3790-48e3-b646-732b5352c426 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:29.054273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4ccb85e7-3790-48e3-b646-732b5352c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:29.136998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 115/210] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:29.165658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491ad51-bd35-4852-a7d6-1cc724fb9d84 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.283296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491ad51-bd35-4852-a7d6-1cc724fb9d84 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.297031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd29f3-d9c1-404e-8806-fb9cfda45e2e None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.297267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd29f3-d9c1-404e-8806-fb9cfda45e2e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.297485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd29f3-d9c1-404e-8806-fb9cfda45e2e None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.299267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 116/211] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:29.304793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.305081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.305358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.322947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.323747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.323855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:29.324018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.324294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.325210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:29.337845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:29.348562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.350180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:29.350957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 96/212] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.356476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.415924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 117/213] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:29.439588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.468330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357172f9-9dc0-4527-a58f-8a4e5497a33b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.508191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.508888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.509170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.509443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.510300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:29.510611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.512021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.521021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 97/214] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.526944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.553546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252c53e-9038-4e4c-9122-8d0739ecb42e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.586696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.587480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.587756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.588023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.589188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.590622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ad3e-35cf-4757-9962-2ce70103cb22 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.592210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 118/215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:29.593481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be410e9f-d3ca-40c7-894b-aa31547445f8 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.593763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be410e9f-d3ca-40c7-894b-aa31547445f8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.594034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be410e9f-d3ca-40c7-894b-aa31547445f8 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.595237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 119/216] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:29.600404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be410e9f-d3ca-40c7-894b-aa31547445f8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.625309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304d779-aeec-41b8-93d0-67343fecd1cd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.657883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.658738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.659014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.659283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] PATH_INFO: `/v3/users/acd7a52ec47240b0ab62801b9d088e51` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.672415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] RBAC: Authorizing `identity:get_user(user_id=acd7a52ec47240b0ab62801b9d088e51)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.673957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59ac6-06e5-4451-a212-70e594ad89a1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.675609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 98/217] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/users/acd7a52ec47240b0ab62801b9d088e51 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:29.676806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.677085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.677355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.693779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:29.694947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:29.702967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be410e9f-d3ca-40c7-894b-aa31547445f8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.735678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.736341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.736619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.736925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.737629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.739056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.760011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 120/218] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:29 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:29.760181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 99/219] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:29.760644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.783228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.895687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e18-feff-4d3b-8f1f-a8988fcae491 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.910668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668797-3cf8-4980-afc1-9431f9adefc1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.942151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.942883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.943477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.943477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.946378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.947172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.947449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.947716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.961733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:29.969629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.970533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:29.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 100/220] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.979239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.027159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.030007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.096352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882ac4b-4a05-482e-b95c-bf8d610e5eea None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.134371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.135046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.135325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.135596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.137009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:30.137009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.138169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.148244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 101/221] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:30.154324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.167301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 121/222] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:30.173924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.258404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896a9f-b3a5-4f32-a967-f946988e94bb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.293661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.294542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.294820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.295097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.296279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.297750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.299381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 102/223] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:30.304773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.331576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3f00-a5cd-4bf6-8a27-8238d546d76c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.411195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661178-ace6-4cc1-aca7-3bcecbf1a843 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.442735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.444767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.445253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.445743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.445845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.446621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.446901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.447170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.447943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.448346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.449819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.449929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.460899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 103/224] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:30.461077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 122/225] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:30.461155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.466957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.566343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da743-f7c2-4cc5-86e1-d9b61ddc00d1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.619716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.620828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.621107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.621378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/users/9d039e2de79344b3ae7862b0696346f5/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.623907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, user_id=9d039e2de79344b3ae7862b0696346f5, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.624824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a87cd-79dd-4760-a862-4ab5df757b94 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.625379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5fa28-58c1-4aac-81af-773df6295b5c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.642194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 104/226] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:30 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/users/9d039e2de79344b3ae7862b0696346f5/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:30.645567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4afa58-81d4-4daa-80a3-ed3b8eca1654 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.646071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4afa58-81d4-4daa-80a3-ed3b8eca1654 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.647101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4afa58-81d4-4daa-80a3-ed3b8eca1654 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.657053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 105/227] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:30.658839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.660553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.661090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.690750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.691848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.692344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.692922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.694477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=acd7a52ec47240b0ab62801b9d088e51) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:30.695033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.696720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.698105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:30.701652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:30.709260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 123/228] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/role_assignments?user.id=acd7a52ec47240b0ab62801b9d088e51&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:30.799527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 106/229] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:30.836224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.962300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd6ac9-e808-4507-8aa3-2db9419a4d2f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.998067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.998877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.999156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.999431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.010519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:31.018558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:31.019449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:31.020227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 124/230] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:31.025647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.126096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fc26-f603-467f-8c6f-19e051b18c05 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.159382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.160048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.160325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.160662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.161416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:31.162262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.163704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.172231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 107/231] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:31.178363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.296070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4b0c-b111-40a9-91d8-7f61216acb82 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.332521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.333495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.334453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.334887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.336192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.337675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.339369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 125/232] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:31.344926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.447150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5b5c0-9c67-4e3e-8e27-a29adaba830c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.480369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.481269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.481547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.481820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.483005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.484456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e330123-c3cc-4c86-b652-b224f0319e04 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.486174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 108/233] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:31.492470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.600432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0268e-dc4e-4aae-9917-51296638efb6 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.641341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.642235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.642517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.642788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/users/9d039e2de79344b3ae7862b0696346f5/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.645081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, user_id=9d039e2de79344b3ae7862b0696346f5, role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.647146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbd62c-41a9-4867-860e-3f6381662bf6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.675484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 126/234] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:31 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/users/9d039e2de79344b3ae7862b0696346f5/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:32.527173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e2ac-ce42-47d8-b7ed-7178948c873d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.527682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e2ac-ce42-47d8-b7ed-7178948c873d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.527758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e2ac-ce42-47d8-b7ed-7178948c873d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.529622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 109/235] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:32.535119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adb83-cbcc-4f29-816c-6ec87d5cd09d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.535553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adb83-cbcc-4f29-816c-6ec87d5cd09d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.535752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adb83-cbcc-4f29-816c-6ec87d5cd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.553361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4f1adb83-cbcc-4f29-816c-6ec87d5cd09d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:32.554547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4f1adb83-cbcc-4f29-816c-6ec87d5cd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:32.637269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 127/236] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:32.674803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440e2ac-ce42-47d8-b7ed-7178948c873d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.719322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fee89-b906-414a-a629-cf8f0fb3118f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.719322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fee89-b906-414a-a629-cf8f0fb3118f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.719322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fee89-b906-414a-a629-cf8f0fb3118f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.719322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 128/237] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:32.726053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.726585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.727063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.744079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:32.745579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:32.791239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440e2ac-ce42-47d8-b7ed-7178948c873d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.825111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.825861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.826138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.826413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.836790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:32.844667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 129/238] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:32.844892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:32.845733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:32.846509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 110/239] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:32.853897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.873411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.956975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5fb3-c3eb-4b14-abdb-e3bc71f21002 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.996288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.996986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.997262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.997527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.998273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:32.998572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.999948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.021294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 111/240] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.023349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.039889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a648b37-5f31-4808-a921-d7eb1236d8dc None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.105813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.106619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.106899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.107171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.108370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.111605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.118442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 130/241] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.123751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.167268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32487e-bcca-413c-9fec-b3fe8a465dda None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.202528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.203401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.203680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.203953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] PATH_INFO: `/v3/users/a7a065624fd44046bd27f3f77018152c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.218045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] RBAC: Authorizing `identity:get_user(user_id=a7a065624fd44046bd27f3f77018152c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.219532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.221431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 112/242] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/users/a7a065624fd44046bd27f3f77018152c => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.228914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.328432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309cdca-5d21-42ef-9adf-368ac6b32e5c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.358892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd4106-dfd9-4dd3-9512-d73d8f284275 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.363631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.364292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.364604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.365480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.439154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.440766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71417c-e206-4b8d-8b5d-51e76fcd661e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.449364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.450471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.450955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.451422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.452326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.453990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.491991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 131/243] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:33 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:33.546083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 113/244] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:33.551779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.618678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0942-a241-4a7b-984c-12d1bbf982dc None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.618957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0942-a241-4a7b-984c-12d1bbf982dc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.619147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0942-a241-4a7b-984c-12d1bbf982dc None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.620543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 114/245] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:33.625990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.626272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.626546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.651224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:33.652468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:33.732529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fb34-f46c-4d96-bc26-dc22f3fec174 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.775556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 115/246] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 03:00:33.776891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.777143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.777424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.777699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.779184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.780625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.782720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 132/247] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.788560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.809780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.913697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37e04-6df9-4b18-a86a-71c83cbb9c7b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.931068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054600b-560e-4b2b-9d4d-492fe19bf050 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.965468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.966489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.966779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.967050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.967883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=a7a065624fd44046bd27f3f77018152c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:33.968191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.969668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651964-479f-44a3-a599-f07e3a8c4b87 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.978288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.979330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.979436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 116/248] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/role_assignments?user.id=a7a065624fd44046bd27f3f77018152c&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.979534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.979605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.980466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da5d-7eb5-49b6-aded-9014ea1cedf7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.980798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da5d-7eb5-49b6-aded-9014ea1cedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.981068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da5d-7eb5-49b6-aded-9014ea1cedf7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.982397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 117/249] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:33.988208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.988633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.989058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.992031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:33.999929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.000960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:34.001749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 133/250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:34.008015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.010286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:34.011481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:34.088540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 118/251] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:34.112448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.128255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75786aa9-038c-4aa0-84cb-04b433fd9044 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.164998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.165595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.165874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.166140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.166892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.167195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.168586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.180710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 134/252] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.183772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.270804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed07499-dd35-4580-85b5-b953cb2da151 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.286873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c787-ad0c-4c81-8c55-66de4c6a2cf6 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.320844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.321714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.321991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.322331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] PATH_INFO: `/v3/users/acd7a52ec47240b0ab62801b9d088e51` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.324178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] RBAC: Authorizing `identity:get_user(user_id=acd7a52ec47240b0ab62801b9d088e51)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.324923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.326548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 135/253] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/users/acd7a52ec47240b0ab62801b9d088e51 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:34.331871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.338215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.339276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.339728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.340168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.364385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:34.373368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.374352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:34.375190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 119/254] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:34.385815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.576799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931abe-261f-4416-be96-4041e2e5194f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.593889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16643b51-762b-4e83-b16e-6aee99463f65 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.651408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e476d4-c039-465f-be31-53666e58195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.652917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e476d4-c039-465f-be31-53666e58195a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.654050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e476d4-c039-465f-be31-53666e58195a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.654913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e476d4-c039-465f-be31-53666e58195a None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.657446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.658262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e476d4-c039-465f-be31-53666e58195a None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.659072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.660685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e476d4-c039-465f-be31-53666e58195a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.661131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.661560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.663025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.664943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 136/255] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.665411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.666946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b68b60-3136-4691-a88e-80c01dbb1979 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.668348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8a1-3fba-4553-9877-42fccdc4ec56 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.670205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8a1-3fba-4553-9877-42fccdc4ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.670631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8a1-3fba-4553-9877-42fccdc4ec56 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.672071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 137/256] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:34.673699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd8a1-3fba-4553-9877-42fccdc4ec56 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.682935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 120/257] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.691229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.691699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.692115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.711432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:34.713023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:34.830729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 121/258] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:34.832161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.870384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd8a1-3fba-4553-9877-42fccdc4ec56 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.913663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.914819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.915270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.915686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/users/acd7a52ec47240b0ab62801b9d088e51/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.917902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, user_id=acd7a52ec47240b0ab62801b9d088e51, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.919550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.936805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 138/259] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:34 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/users/acd7a52ec47240b0ab62801b9d088e51/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:34.938244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.043301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25d6d-e6e1-498f-97c7-b8e22ffc15c3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.059947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3edb6b-90ac-4d77-b45d-fab975cd8043 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.100799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.101883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.102308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.102721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.116457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:35.125935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:35.127060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:35.127981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:35.130396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 139/260] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:35.139373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.149406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.150406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.150571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.150833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.152089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.153840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.155764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 122/261] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.160925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.254565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded8-f314-4886-87cb-2889437a954e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.291318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.292227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.292697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.293114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.294002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:35.294450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.296020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.306962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 140/262] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:35.312983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.333255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5d5e-0f32-4df6-9658-ef553c42a54a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.422010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.422590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.422866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.423139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.426633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0718-2cbd-447c-9fa4-cf75f570a40a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.464536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.465750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.466185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.466638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] PATH_INFO: `/v3/users/9d039e2de79344b3ae7862b0696346f5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.467967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] RBAC: Authorizing `identity:get_user(user_id=9d039e2de79344b3ae7862b0696346f5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.469740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.472050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 141/263] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/users/9d039e2de79344b3ae7862b0696346f5 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.477387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.523173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.524677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.618216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f1232-6cd9-4d9b-82e5-c860e5c90194 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.624049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 123/264] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:35.629753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.652910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.654058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.654480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.654891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.724629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.726395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.768786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a040f1-f4c7-498c-8b0a-cda28c8e0b68 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.810721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.811593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.811874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.812147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.817373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.819449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.821552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 124/265] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.827032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.855916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 142/266] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:35.861030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.992771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a4dcd-640a-4661-9adb-5fd76b1f6cf0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.006363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5e9e-6393-42e2-aab8-27e3a670038b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.040455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.041817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.042367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.042879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.044251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.045897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.048075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 143/267] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:36.049681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=9d039e2de79344b3ae7862b0696346f5) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.055273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3704e-38b2-4a88-9a93-15dfac5c7685 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.056757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.060848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 125/268] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/role_assignments?user.id=9d039e2de79344b3ae7862b0696346f5&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:36.162240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef7e6-81ce-45d5-8cb6-476532c01463 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.197949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.198629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.198906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.199183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.200018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=9d039e2de79344b3ae7862b0696346f5) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.200336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.201799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087b45-6192-4952-bcd5-466eb5c3bd78 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.209318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 144/269] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/role_assignments?user.id=9d039e2de79344b3ae7862b0696346f5&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.777255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972d20-ef70-4b01-aed1-20416956ebee None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.778532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972d20-ef70-4b01-aed1-20416956ebee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.779014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972d20-ef70-4b01-aed1-20416956ebee None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.781014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 126/270] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:36.786303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99638e-052a-4a96-9352-5b3a29e1014b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.787729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99638e-052a-4a96-9352-5b3a29e1014b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.788198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99638e-052a-4a96-9352-5b3a29e1014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.809975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2c99638e-052a-4a96-9352-5b3a29e1014b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:36.811483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2c99638e-052a-4a96-9352-5b3a29e1014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:36.896252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 145/271] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:36.923273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6972d20-ef70-4b01-aed1-20416956ebee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.054800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6972d20-ef70-4b01-aed1-20416956ebee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.102311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.103499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.103902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59033-05ce-466c-90df-2fd2d7c8aa09 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.104030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.104242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.104837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59033-05ce-466c-90df-2fd2d7c8aa09 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.105312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59033-05ce-466c-90df-2fd2d7c8aa09 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.105479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.106879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.107232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 146/272] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:37.111142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 127/273] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.112299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25b53-d323-4b04-b9b8-539e310485f9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.112636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25b53-d323-4b04-b9b8-539e310485f9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.112994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25b53-d323-4b04-b9b8-539e310485f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.115727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.135211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-42d25b53-d323-4b04-b9b8-539e310485f9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:37.136371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-42d25b53-d323-4b04-b9b8-539e310485f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:37.213028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 147/274] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:37.213028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980a57-6336-4f44-bff3-389f148d84c4 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.213028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980a57-6336-4f44-bff3-389f148d84c4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.213028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980a57-6336-4f44-bff3-389f148d84c4 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.213028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 148/275] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:37.215829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.216110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.216382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.223376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab703e-206b-479b-a69e-b03af2695490 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.234680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:37.235839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:37.258259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.259208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.259671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.260100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.260968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.262549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.283863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 128/276] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:00:37 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:37.284937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.305322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 149/277] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:37.332716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.420687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636c4f-7d0f-4590-a328-fe4be5abd4bb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.443583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a62b-d522-4d38-97f5-cc6c64a346bb None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.460260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.461304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.461643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.462037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.474337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:37.481833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:37.482717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:37.483518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 129/278] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:37.489448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.491592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.492751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.492751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.492751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.503520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:37.512427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:37.513354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:37.514132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:37.514747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 150/279] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:37.520222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.616234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d674df-2815-4916-ad6a-5a8d4fcd502b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.653529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3de5-7d6c-4842-b1da-5a1b5a0c8e24 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.661004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.661949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.662403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.662675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.663429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.663732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.665186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.674269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 130/280] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:37.681032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.697459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.698179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.698463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.698733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.699558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.699782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.702228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.710390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 151/281] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:37.715945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.800455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66936d4-e774-4aa5-83cb-e40c69f22d29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.837741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.838674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.838952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.839695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] PATH_INFO: `/v3/users/a7a065624fd44046bd27f3f77018152c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.840934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a065624fd44046bd27f3f77018152c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.842381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.844321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 131/282] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/users/a7a065624fd44046bd27f3f77018152c => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:37.851110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.901061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d0f71-075a-4e08-862e-0d4feb168de1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.967875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.968777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.969052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.969324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] PATH_INFO: `/v3/users/8e37cec79cd1405492e3d6f31ad30ee8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.991346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] RBAC: Authorizing `identity:get_user(user_id=8e37cec79cd1405492e3d6f31ad30ee8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.993189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.995436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 152/283] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/users/8e37cec79cd1405492e3d6f31ad30ee8 => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:38.000623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.001526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6998-1360-44af-8642-b02924b49ca3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.072965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.073841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.074125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.074400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.076202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.077710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d05b7-e0c6-4c9a-9a95-4199a1042cdc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.079707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 132/284] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:38.081116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56ce06-ccf2-4140-a59a-d3f55a7b16d8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.081578 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56ce06-ccf2-4140-a59a-d3f55a7b16d8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.081995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56ce06-ccf2-4140-a59a-d3f55a7b16d8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.084843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 133/285] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:38.089242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56ce06-ccf2-4140-a59a-d3f55a7b16d8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.168223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f449a-16ba-46dc-876e-63db13b79966 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.196210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56ce06-ccf2-4140-a59a-d3f55a7b16d8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.212117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.212807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.213090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.213362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.214361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, user.id=8e37cec79cd1405492e3d6f31ad30ee8, scope.system=all) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.214959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.216404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef77b6-679b-49f4-be33-b1884dff1ff4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.223361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 153/286] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/role_assignments?user.id=8e37cec79cd1405492e3d6f31ad30ee8&scope.system=all&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:38.225819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.226237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.226526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.233334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.234614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.235116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.235580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/users/a7a065624fd44046bd27f3f77018152c/roles/613ecc5b62194fec8dba1aea94811f6c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.238028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, user_id=a7a065624fd44046bd27f3f77018152c, role_id=613ecc5b62194fec8dba1aea94811f6c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.240100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.249112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:38.249112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:38.267440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 134/287] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:00:38 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/users/a7a065624fd44046bd27f3f77018152c/roles/613ecc5b62194fec8dba1aea94811f6c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:38.326527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 154/288] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:38.351490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.462643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3ec0-cdb2-4e11-951c-00edb8104dba None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.498708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.499512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.499791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.500062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.511086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:38.518876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:38.519758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:38.520556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 135/289] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:38.533786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.655945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4145fe-5151-41e3-9796-8f5350819082 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.691588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.692264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.692544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.692960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.693727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.694036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.695441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.704492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 155/290] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:38.710375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.813235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9425c2-3ee3-4ef6-a15b-850b291caf04 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.850080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.850964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.851238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.851506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] PATH_INFO: `/v3/users/acd7a52ec47240b0ab62801b9d088e51` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.852728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] RBAC: Authorizing `identity:get_user(user_id=acd7a52ec47240b0ab62801b9d088e51)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.854166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.860262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 136/291] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/users/acd7a52ec47240b0ab62801b9d088e51 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:38.861647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.964437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439c5-90ff-428c-9e1f-c8d537d930cb None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.998038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.998686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.998967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.999237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.100233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.101625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.233756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 156/292] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:39.241826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.351823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c576-01ff-4f30-919c-d4aa68a8fc29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.385778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.386636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.386918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.387190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.388374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.389849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8b86c-a507-4865-926c-5841b723198e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.396346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 137/293] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:39.397916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.535779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24bd0-2bcb-496c-a69d-647744b773b1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.570211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.570864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.571141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.571411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.572239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=acd7a52ec47240b0ab62801b9d088e51) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:39.572545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.574022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fd3e-7eef-44dd-b9e6-13412f4cb4f2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.580331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 157/294] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/role_assignments?user.id=acd7a52ec47240b0ab62801b9d088e51&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:40.031084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b30e-4a1f-4304-88ae-c5ba420aa758 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.032103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b30e-4a1f-4304-88ae-c5ba420aa758 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.032579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9b30e-4a1f-4304-88ae-c5ba420aa758 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.034547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 138/295] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:40.040473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.041352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.041820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.072873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:40.074342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:40.144784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 158/296] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:40.169278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9b30e-4a1f-4304-88ae-c5ba420aa758 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.283981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9b30e-4a1f-4304-88ae-c5ba420aa758 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.324193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.325387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.325862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.326325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.327693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.329339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8f93b-b78b-4b11-b85f-8e29ddf05f74 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.331457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 139/297] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:40.337532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.445896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199896-35c4-492b-8b0d-97d16ae03be2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.474905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8aca7-b170-4a71-8f10-c5f8e0341cff None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.475231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8aca7-b170-4a71-8f10-c5f8e0341cff None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.475593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8aca7-b170-4a71-8f10-c5f8e0341cff None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.477376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 140/298] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:40.482924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.483209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.483483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.491107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.492060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.492535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.493023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] PATH_INFO: `/v3/groups` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.493903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.496112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b15c6-f88c-4723-8caa-a013dd766e3d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.501574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:40.502902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:40.513957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 159/299] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:40.581688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 141/300] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:40.604334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffaf0a-978b-41ac-baae-2542e042d594 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.605240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffaf0a-978b-41ac-baae-2542e042d594 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.605716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffaf0a-978b-41ac-baae-2542e042d594 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.606193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.607866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 160/301] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:40.613154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.613439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.613713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.634910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:40.636831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:40.715078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a056-d8df-481a-b515-2519e1fa9c6e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.734839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 161/302] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:40.757723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.760492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.761599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.762094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.762584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.776187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:40.784216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:40.785262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:40.786031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 142/303] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:40.792994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.870183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de3fc-bedc-4c95-a488-e4844b5441e9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.897763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2482ee-24d6-4aa4-9590-9f70dfd1a8d4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.905549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.906648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.907121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.907582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.918406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:40.926710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:40.927654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:40.928435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:40.929581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 162/304] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:40.934667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.935336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.935613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.935882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.936630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.936959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.938357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.944674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.948852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 143/305] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:40.954220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.063068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e832d0-6795-457b-b3e1-8fa1aecf95ff None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.071213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadd3c1-938f-46b5-8769-798d7ca7e8ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.097705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.098605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.098913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.099220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] PATH_INFO: `/v3/users/7e1ceb4289924260a83347d005628585` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.107735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.108416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.108726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.108998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.109777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:41.110082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.111503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.115761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1ceb4289924260a83347d005628585)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.117408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.119312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 144/306] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/users/7e1ceb4289924260a83347d005628585 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:41.125301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.127201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 163/307] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:41.133523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.225801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a8b7a-3426-4218-bb0d-55f2877589b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.235106 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9a3a-1f21-4b35-bba9-f4327122e9a3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.259942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.260622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.260885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.261157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.261981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, user.id=7e1ceb4289924260a83347d005628585, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:41.262288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.263735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.269473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 145/308] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/role_assignments?user.id=7e1ceb4289924260a83347d005628585&scope.system=all&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:41.279197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.280093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.280371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.280641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] PATH_INFO: `/v3/users/8e37cec79cd1405492e3d6f31ad30ee8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.282129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] RBAC: Authorizing `identity:get_user(user_id=8e37cec79cd1405492e3d6f31ad30ee8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.283664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7338-6237-4ec0-a23b-cdc9106929d7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.285755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 164/309] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/users/8e37cec79cd1405492e3d6f31ad30ee8 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:41.291931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.301291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d52c0-7793-4a53-8707-abf238221d28 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.301601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d52c0-7793-4a53-8707-abf238221d28 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.301844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d52c0-7793-4a53-8707-abf238221d28 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.304111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 165/310] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:41.309872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.310207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.310433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.328995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:41.330222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:41.416537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 166/311] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:41.423187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64470-6b20-4fc9-8084-6b3331329bce None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.440162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.462849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.463944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.464365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.464836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] PATH_INFO: `/v3/system/users/8e37cec79cd1405492e3d6f31ad30ee8/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.466481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8e37cec79cd1405492e3d6f31ad30ee8, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.467921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.478705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 146/312] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 10 03:00:41 2022] PUT /identity/v3/system/users/8e37cec79cd1405492e3d6f31ad30ee8/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:41.556951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617c55-2a08-49d2-80ec-9fbe2280e9d6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.593112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.593918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.594196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.594464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.606689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:41.615374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:41.616313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:41.617131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 167/313] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:41.622995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.737054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68add-3ae9-499f-a650-513908942537 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.773591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.774681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.775154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.775618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.776576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:41.777113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.778929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.788490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 147/314] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:41.793561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.897543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37564f3-3aa5-47e7-b125-fa9e20f81b73 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.932475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.933720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.934194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.934658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] PATH_INFO: `/v3/users/a7a065624fd44046bd27f3f77018152c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.936061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] RBAC: Authorizing `identity:get_user(user_id=a7a065624fd44046bd27f3f77018152c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.937771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.940111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 168/315] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/users/a7a065624fd44046bd27f3f77018152c => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:41.946098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:42.045102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48041c5-6cbc-46ff-8c84-bf69f2ccdd2b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:42.079498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:42.080214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.080422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.080727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.147943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:42.149436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:42.247683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 148/316] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:42.253161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:42.354597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655aafc-c75e-437d-b6e8-79d7db18282d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:42.388206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:42.389099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.389380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.389654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.390849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:42.392273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b67f-2291-404d-9d9d-db7d22387e4a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:42.393986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 169/317] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:42 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:42.400445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:42.503252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094182f5-56ed-48cb-865f-621ce6193fb9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:42.537545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:42.538875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.539352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.539817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.541017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, scope.project.id=f7e7f8f0018a4824a860113200766575, user.id=a7a065624fd44046bd27f3f77018152c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:42.541532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:42.543186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9717c-d23f-498a-a13b-d5e6e6c0ee10 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:42.550130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 149/318] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:00:42 2022] GET /identity/v3/role_assignments?user.id=a7a065624fd44046bd27f3f77018152c&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:42.858464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b892-3c94-40c6-941c-140a043f34c7 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.858845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b892-3c94-40c6-941c-140a043f34c7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.859019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b892-3c94-40c6-941c-140a043f34c7 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.860511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 170/319] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:42.865512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.865800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.866076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.882122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:42.883271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:42.947425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 150/320] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:42.969773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06b892-3c94-40c6-941c-140a043f34c7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.071886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06b892-3c94-40c6-941c-140a043f34c7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.103169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.103950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.104227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.104495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.105678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.107104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd2a07-8900-4f8d-a06a-c4e62052045c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.108934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 171/321] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:43.114252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.207616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5d4f-e75a-46b0-95a6-1f8289225322 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.240582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.241271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.241542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.241804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] PATH_INFO: `/v3/groups` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.242485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.243962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1785b04-f21b-4cec-8381-fa402dcd1fe7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.261305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 151/322] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 10 03:00:43 2022] POST /identity/v3/groups => generated 226 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:43.559771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883735c-6d0a-44fc-8d00-0e5fc479322f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.560277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883735c-6d0a-44fc-8d00-0e5fc479322f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.560352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883735c-6d0a-44fc-8d00-0e5fc479322f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.562014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 172/323] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:43.567720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.568008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.568396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.586566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:43.587749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:43.657331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 152/324] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:43.682783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883735c-6d0a-44fc-8d00-0e5fc479322f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.791885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883735c-6d0a-44fc-8d00-0e5fc479322f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.828767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.829511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.829790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.830061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.840666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-945ec535-5baf-4b90-a4ac-94cc820ec7d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:43.848520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:43.850008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:43.850872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 173/325] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:43.856168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.859416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579dbdd-7ae2-405a-9270-8bf000b29716 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.859703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579dbdd-7ae2-405a-9270-8bf000b29716 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.859972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579dbdd-7ae2-405a-9270-8bf000b29716 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.861493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 174/326] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:43.868318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.868586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.869010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.889652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:43.890823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:43.965714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d586a-ac8f-4bf1-b011-f22cbb9ec114 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.966027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 175/327] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:43.988626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.007477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.008153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.008432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.008779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.009539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.009843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.011223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.022430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 153/328] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:44.028295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.095744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39610ac1-ad7a-40da-bef2-b666ca559ee9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.131674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.132482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.132786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.133223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.144605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:44.150651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f086-4999-4a7b-9d41-45d896b0b127 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:44.154455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:44.155500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:44.156463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:44.158737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 176/329] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:44.165249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.193686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.194904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.195329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.195743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] PATH_INFO: `/v3/users/7e1ceb4289924260a83347d005628585` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.205496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1ceb4289924260a83347d005628585)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.206979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.209721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 154/330] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/users/7e1ceb4289924260a83347d005628585 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:44.215276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.265768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde33f4-34b9-4015-b04b-523669b19538 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.310307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.310985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.311266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.311541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.312290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.312596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.314005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.327007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 177/331] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:44.332237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.336887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ed5dc-f9bb-4485-80e1-40021d1d7342 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.374635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.375418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.375699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.375975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] PATH_INFO: `/v3/system/users/7e1ceb4289924260a83347d005628585/roles/613ecc5b62194fec8dba1aea94811f6c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.379414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e1ceb4289924260a83347d005628585, role_id=613ecc5b62194fec8dba1aea94811f6c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.381028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.400371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 155/332] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 10 03:00:44 2022] PUT /identity/v3/system/users/7e1ceb4289924260a83347d005628585/roles/613ecc5b62194fec8dba1aea94811f6c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:44.469569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8c02-68fd-4836-abf5-8767b25385f4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.514738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.515635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.515898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.516173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] PATH_INFO: `/v3/users/8e37cec79cd1405492e3d6f31ad30ee8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.517427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] RBAC: Authorizing `identity:get_user(user_id=8e37cec79cd1405492e3d6f31ad30ee8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.518951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a393d-66b7-4ab8-b8f1-f81155303a72 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.521410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 178/333] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/users/8e37cec79cd1405492e3d6f31ad30ee8 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:44.527598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.652624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6fa3-3cae-4d3d-afca-356a8420eb35 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.693081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.694118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.694600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.695123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.696228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] RBAC: Adding query filter params (role.id=adc3123199d941ea88fc13d1bb807ff1, user.id=8e37cec79cd1405492e3d6f31ad30ee8, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.696756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.698412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9c809-5bdb-4f7d-9908-ef3305a9571c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.713616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 156/334] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/role_assignments?user.id=8e37cec79cd1405492e3d6f31ad30ee8&scope.system=all&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.222224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6a10-4151-478c-b20f-67578eb3deec None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.223244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6a10-4151-478c-b20f-67578eb3deec None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.223784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6a10-4151-478c-b20f-67578eb3deec None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.225672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 179/335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:46.238529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.239479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.240087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.263218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:46.264781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:46.350808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 157/336] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:46.387469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e6a10-4151-478c-b20f-67578eb3deec None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.494315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e6a10-4151-478c-b20f-67578eb3deec None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.530206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.531372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.531874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.532343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.545097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:46.553385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:46.554260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:46.555044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:46.557651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 180/337] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:46.563039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.672572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d85f-b3e2-460e-8f40-4b49e658a7c5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.711708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.712756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.713262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.713729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.714677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:46.715175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.716842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.726652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 158/338] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.731887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.857936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358aa7-65b1-4cb8-b12d-ac4570edbf9b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.898414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.899414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.899917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.900390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.977869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.979668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13740236-dc83-4878-ba36-c67b821e01ad None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.094872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 181/339] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:47.100626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.210169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eccb-8b6a-41d3-94b1-4d6712345aec None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.247727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.250309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6cc1-7761-4495-9096-6aefc507a47b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.251098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6cc1-7761-4495-9096-6aefc507a47b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.251571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6cc1-7761-4495-9096-6aefc507a47b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.253171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 182/340] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:47.254046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.254527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.255058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.260628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.263239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.263239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.263239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.263481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.264525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 159/341] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.270092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.291747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:47.293284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:47.374346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f170d4-da21-47f3-9a13-bb3dacbef21f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.395984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 183/342] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:47.423472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.424591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.425035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.425480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.437372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.439047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.441233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 160/343] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:47.447426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.454328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.555721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b7fb-32e8-45c9-aa2d-c857f75379c5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.561501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675d8d-0951-468a-b313-4c0ed397ff1d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.590213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.591261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.591746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.592192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.603189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.603511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:47.603991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.604337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.604697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.605601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.605973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.607471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c759-77cd-4359-9ace-99fa1390e4b6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:47.613055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:47.613954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:47.614871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:47.617126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 161/344] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:47.619933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 184/345] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.633741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.755434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f61b6-a825-459e-9dc1-af5deae6d68c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.764837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0141-241d-4af9-bd60-4fe6a37c24d0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.765482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0141-241d-4af9-bd60-4fe6a37c24d0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.765953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0141-241d-4af9-bd60-4fe6a37c24d0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.767624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 185/346] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:47.778442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca1ab-b5e1-44c1-8169-7551474aef95 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.779049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca1ab-b5e1-44c1-8169-7551474aef95 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.779535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca1ab-b5e1-44c1-8169-7551474aef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.794176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.794915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.795201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.795512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.796244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.796550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.798010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.808056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 162/347] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.813307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.814466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2faca1ab-b5e1-44c1-8169-7551474aef95 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:47.815833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2faca1ab-b5e1-44c1-8169-7551474aef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:47.922195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f146f-3698-43de-a7cd-476fe32b99f7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.924863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 186/348] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:47.954360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10f-371f-481f-a7bf-9835020f2c4e None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.954978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10f-371f-481f-a7bf-9835020f2c4e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.955445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10f-371f-481f-a7bf-9835020f2c4e None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.957249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 187/349] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:47.959282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.959927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.960250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.960483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.964919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.965516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.965986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.985705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:47.987250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:48.032600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.034096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc777-39e1-453a-8f7a-538afa68d134 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.062465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 188/350] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:48.064043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.171372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 163/351] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:48.173102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35701e7f-38c1-4fd3-835b-8dfc2fcf85c1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.173614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35701e7f-38c1-4fd3-835b-8dfc2fcf85c1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.174082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35701e7f-38c1-4fd3-835b-8dfc2fcf85c1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.176282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 164/352] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:48.177422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35701e7f-38c1-4fd3-835b-8dfc2fcf85c1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.208694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741323-4ee6-4a08-a29b-96a0344b9758 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.254631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.257556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.257983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.258394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.273899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:48.285001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:48.286132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:48.287124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:48.289904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 189/353] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:48.291237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.295092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35701e7f-38c1-4fd3-835b-8dfc2fcf85c1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.334786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.336017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.336530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.337095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.350102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9375bd21-4199-4e66-8500-7e62ab22d742 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:48.358372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:48.359292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:48.360097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:48.363305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 165/354] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:48.364893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.365426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.366005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.386568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:48.388149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:48.413117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce215-c1be-4fb0-b937-71aa0964e84b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.454295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.455588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.456221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.456744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.458822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.461712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.465703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 190/355] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.467469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.471768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 166/356] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:48.473555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.591247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67cc07-5634-4d32-8ff0-dcae787cd013 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.592069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1b05-4db0-4f3f-8879-39ac95760fe3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.629982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.631111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.631389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.631814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.632056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.632334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.632601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.632911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.633378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.633677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.634266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.634776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.635016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.636640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.644739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 191/357] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.645955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.647822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 167/358] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.648878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.760538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7de97-e6b9-47d8-a1db-a1d95775ed3d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.774894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2745c-ba51-4567-a14b-53a187953f00 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.800936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.802297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.802579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.802848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.813104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:48.816685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.818433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.818928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.819402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.820845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:48.821979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:48.822859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:48.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:48.825635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.833172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 192/359] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.833444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 168/360] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:48.833574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.833669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.954707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ae1d-42fd-427a-8cb0-6b1a233dda58 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.961396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c4cb-d4b1-44ef-ae33-087f0c09f84c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.993064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.994005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.994457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.994949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.002162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.002812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.004042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.004042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.096065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.097566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eab20-7d3c-4c16-8162-06813ee4f19e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.099661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.100995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.208875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 193/361] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:49.211158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1188a2b-464e-4239-9312-d0fb9a1d2074 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.211158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1188a2b-464e-4239-9312-d0fb9a1d2074 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.211158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1188a2b-464e-4239-9312-d0fb9a1d2074 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.212906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 194/362] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:49.212906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1188a2b-464e-4239-9312-d0fb9a1d2074 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.215735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 169/363] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:49.216950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.335444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dfaa6-b0f8-4305-82ed-58aa42274312 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.341489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1188a2b-464e-4239-9312-d0fb9a1d2074 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.384211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.387961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.388263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.388338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.388416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.388416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.388544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:49.388544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.388772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:49.388772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.388932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a438f-a2b1-4a55-b88d-743a14445bf4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.389013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.394335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 170/364] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.395229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.402726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 195/365] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.404420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.404814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.405160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.423700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:49.425089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:49.514955 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13f24-edfa-4ef4-a275-3183d8189e16 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.522301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 196/366] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:49.523160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.584019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.584931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.585215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.585488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.586758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.588241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.594867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 171/367] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.595846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.661813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca6db4-36d0-4f76-90a0-33642e90df3f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.695593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.696462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.696765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.697036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.698226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.699662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.701678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 197/368] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.702539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.713474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717206-8df3-4b8b-b471-d83626a9fe6a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.749478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.750413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.750694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.750965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] PATH_INFO: `/v3/users/7e1ceb4289924260a83347d005628585` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.752241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1ceb4289924260a83347d005628585)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.753784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.756035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 172/369] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/users/7e1ceb4289924260a83347d005628585 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.761446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.806756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008014-7498-4a2b-a489-20c1d439e3e3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.842543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.843352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.843630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.843906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.854619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:49.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:49.864687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 198/370] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:49.866880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.877581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575d8f2-9d3c-40c6-a8b4-a896a1d35fc9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.913284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.914157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.914432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.914700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.915892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.917361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.919063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 173/371] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.924534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.968990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27112-9441-4b5a-8c73-a8de8b1cea0a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.003022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.003875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.004151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.004421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.006256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.007699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.009352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 199/372] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.010107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.027721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18d79-88cd-49bd-b473-1a8f2d2ab237 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.068471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.069600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.070167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.070442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.071463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] RBAC: Adding query filter params (role.id=613ecc5b62194fec8dba1aea94811f6c, user.id=7e1ceb4289924260a83347d005628585, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.071777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.073994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.091643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 174/373] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/role_assignments?user.id=7e1ceb4289924260a83347d005628585&scope.system=all&role.id=613ecc5b62194fec8dba1aea94811f6c => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.097455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.144985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1300eb-230e-4bc5-a656-3cbf1913b32a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.232073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.232770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.233098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.233373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.234128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.234534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.235902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.248386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c36b3-9d6c-451e-a065-b31995eafb89 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.258071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 200/374] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.258940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.303533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.303822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.304105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.304375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.305258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=f7e7f8f0018a4824a860113200766575) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.305572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.307399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.316364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 175/375] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.321666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.411621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-9c7f-437c-8010-0d01106a11e0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.456123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22730091-5132-47ca-81ef-f88893955560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.456852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22730091-5132-47ca-81ef-f88893955560 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.457136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22730091-5132-47ca-81ef-f88893955560 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.457471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22730091-5132-47ca-81ef-f88893955560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.458713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22730091-5132-47ca-81ef-f88893955560 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=f7e7f8f0018a4824a860113200766575) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.459034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22730091-5132-47ca-81ef-f88893955560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.460508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22730091-5132-47ca-81ef-f88893955560 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.466937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 201/376] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.468363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c81a-29f0-495e-85fc-220fe70c3308 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.468665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c81a-29f0-495e-85fc-220fe70c3308 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.468946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c81a-29f0-495e-85fc-220fe70c3308 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.470564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 202/377] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:50.476535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.476896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.477116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.491616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc717c-f26f-4c05-9326-a39fdb881035 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.501247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:50.502527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:50.540326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.541049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.541328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.541599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.628280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.630307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.649968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 203/378] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:50.687141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.746796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 176/379] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:50.752366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.862671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85327a-69a3-42e9-9a98-04039e6b572e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.903745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.904990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.905476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.906111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] PATH_INFO: `/v3/projects/2e1554fd89594f468faedf42d5357b2f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.907892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] RBAC: Authorizing `identity:get_project(project_id=2e1554fd89594f468faedf42d5357b2f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.909717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.912703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 177/380] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/projects/2e1554fd89594f468faedf42d5357b2f => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:50.918056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.919665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e7e37-71ad-4fe3-8893-ab51842dd5cb None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.998168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.999480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.999949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.000409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.027727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aee7c-4896-48d0-a272-cf10452d918f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.029590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:51.037516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:51.038441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:51.039216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 204/381] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:51.061582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.069423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.070703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.071182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.071678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] PATH_INFO: `/v3/groups/a916c1eedafc4d54996683a4e121e44c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.078563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] RBAC: Authorizing `identity:get_group(group_id=a916c1eedafc4d54996683a4e121e44c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.080820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.084206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 178/382] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/groups/a916c1eedafc4d54996683a4e121e44c => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:51.090228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.248382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bd8fc-663e-444e-b296-1302bb5997f9 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.279536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06609a-3c5d-46d0-b9cc-d773a068bb75 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.318584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.319314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.319595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.319868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.320618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.320949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.323269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.328316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.329070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.329347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.329613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.330492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] RBAC: Adding query filter params (group.id=a916c1eedafc4d54996683a4e121e44c, role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=2e1554fd89594f468faedf42d5357b2f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.330803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.332228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.337311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 205/383] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.338965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 179/384] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/role_assignments?group.id=a916c1eedafc4d54996683a4e121e44c&scope.project.id=2e1554fd89594f468faedf42d5357b2f&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.342857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.489751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d77a9-19b1-4bf8-9d38-45a3343296f3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.525155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.525992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.526269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.526539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.527739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.529478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.531476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 206/385] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.538246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.649431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c45ad8-4cb6-4de0-9c11-cb362f488eeb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.683666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.684525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.684830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.685131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.686330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.687761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4a82c-602d-4b1b-a51e-6ecd1f1d05f7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.689779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 180/386] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.697736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.852210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f18-7f49-4477-bddb-7b04ff96e672 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.888485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.889438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.889713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.889983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/groups/19adf8a47c284786b72e4a5615ffd44d/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.891923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, group_id=19adf8a47c284786b72e4a5615ffd44d, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.893385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0968cf8-4022-4be0-aee7-f2d091113b81 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.919850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 207/387] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 10 03:00:51 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/groups/19adf8a47c284786b72e4a5615ffd44d/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:52.313571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8823948-8079-4e30-8043-ba82edf6c391 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.313846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8823948-8079-4e30-8043-ba82edf6c391 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.314369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8823948-8079-4e30-8043-ba82edf6c391 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.316189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 181/388] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:52.330289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.330914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.331400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.351401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:52.353092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:52.434562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 208/389] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:52.460562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8823948-8079-4e30-8043-ba82edf6c391 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.597442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8823948-8079-4e30-8043-ba82edf6c391 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.643749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.644934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.645949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.646432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.663217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:52.671852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:52.672781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:52.673581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:52.685235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.697337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 182/390] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:52.810201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360103e2-bdcd-46f4-ad4f-1522921332b5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.862831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.863429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.863706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.864081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.868673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.868673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.868673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.885083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 209/391] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.892364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.103202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9efd06-4179-4169-b2af-c3bf4bcfe3c7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.153417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.154237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.154515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.154791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.156163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.157693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.159777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 183/392] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:53.166188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.299824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfa6f-238b-490e-92f7-2296e635977b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.340812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.341680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.341959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.342226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.343442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.344897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34e5d1-3c15-4f0f-ac8c-0dc4b42bafc5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.346587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 210/393] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:53.353163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.467940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e3f14-ca03-4fa7-9b3c-a9ce51fecd88 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.468315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e3f14-ca03-4fa7-9b3c-a9ce51fecd88 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.468493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e3f14-ca03-4fa7-9b3c-a9ce51fecd88 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.470161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 211/394] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:53.478863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e2dc-efaa-43ca-9d4d-d3aec31829bf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.478863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e2dc-efaa-43ca-9d4d-d3aec31829bf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.478863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e2dc-efaa-43ca-9d4d-d3aec31829bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.502764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4985e2dc-efaa-43ca-9d4d-d3aec31829bf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:53.508147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4985e2dc-efaa-43ca-9d4d-d3aec31829bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:53.532461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8535-5664-41e2-af4f-b803a8694c9e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.589642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.590932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.591306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.591819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/groups/19adf8a47c284786b72e4a5615ffd44d/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.597519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] RBAC: Authorizing `identity:create_grant(project_id=55d6ba97f32c4ea5b957d2d6e1852cda, group_id=19adf8a47c284786b72e4a5615ffd44d, role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.599511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.602725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 212/395] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:53.606352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a824-0edb-440b-9246-0db802a54a60 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.606704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a824-0edb-440b-9246-0db802a54a60 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.607138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6a824-0edb-440b-9246-0db802a54a60 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.610041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 213/396] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:53.619311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 184/397] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 10 03:00:53 2022] PUT /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda/groups/19adf8a47c284786b72e4a5615ffd44d/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:53.626726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.627095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.627444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.647738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.650723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:53.652838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:53.794951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261c81-a703-4fb2-b5db-e8860a1cffef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.807525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 214/398] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:53.838401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.844205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.844205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.844205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.844205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.858540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:53.868707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:53.869679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:53.870471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:53.873290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 185/399] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:53.879939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.978950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799808a-5e18-4352-8011-b3129bea7bdb None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.991923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576574-0c87-4734-8058-c5ca68ebcb4f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.016074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.017027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.017290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.017566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.029332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:54.030120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.031006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.031497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.031958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.032970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:54.033484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.035053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:54.038157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:54.039061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:54.039977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:54.043054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 215/400] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:54.047861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 186/401] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.052216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.077743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.169961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb893ec-c175-4be7-9462-c22855509651 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.210928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.211614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.211891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.212160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.212942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:54.213246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.214655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.235437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 216/402] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.258603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.358694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424ac12-9438-48df-b4b5-d7133896c811 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.376674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d5f87-bcb7-4fbf-8a63-81ae21f78820 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.415183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.416190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.416529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.416836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.418209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.419659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.425067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 217/403] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.428525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.465849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.466737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.467014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.467285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.468530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.470102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.472871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 187/404] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.493886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.549055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c6b0-48d4-46dd-8031-b20a50215e3f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.590404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.591340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.591621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.591940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.594226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.595687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a46e2-b339-484f-aba3-e968571938aa None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.597446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 218/405] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:54.602343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837195bb-9970-4757-a2e8-9f37ca04e939 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.602629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837195bb-9970-4757-a2e8-9f37ca04e939 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.602908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837195bb-9970-4757-a2e8-9f37ca04e939 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.606456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 219/406] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:54.607553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837195bb-9970-4757-a2e8-9f37ca04e939 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.681467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed711-05ee-425e-b8be-2975800b80f6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.715486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.716359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.716633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.718129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.719565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406aa99-3432-4970-a0fa-0065ede94021 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.726736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 188/407] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.728095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.728389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.728824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.730218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837195bb-9970-4757-a2e8-9f37ca04e939 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.745584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:54.746761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:54.773879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.774760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.775041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.775310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/groups/19adf8a47c284786b72e4a5615ffd44d/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.779580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, group_id=19adf8a47c284786b72e4a5615ffd44d, role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.781063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.804888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 220/408] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 10 03:00:54 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/groups/19adf8a47c284786b72e4a5615ffd44d/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:54.805898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.827953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 189/409] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:54.852375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.960067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be4ad-7c0d-468a-a4cf-031142d4ccfd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.997179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.998201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.998486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.998762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.010425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:55.010758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101899be-77f4-41ad-af80-aaae48ab971d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-befaf9ac-db73-424f-b79a-8655ebb59585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:55.018434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.020880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 190/410] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:55.022807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6f44-aa02-40cb-a784-efc471cac9e9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.025183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6f44-aa02-40cb-a784-efc471cac9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.025183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6f44-aa02-40cb-a784-efc471cac9e9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.025183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 191/411] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:55.031138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6f44-aa02-40cb-a784-efc471cac9e9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.065197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.066443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.066926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.067449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575/groups/19adf8a47c284786b72e4a5615ffd44d/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.069996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7f8f0018a4824a860113200766575, group_id=19adf8a47c284786b72e4a5615ffd44d, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.071723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac720b-5f52-408e-a2fe-bc05b5e849bc None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.088409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 221/412] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 10 03:00:54 2022] PUT /identity/v3/projects/f7e7f8f0018a4824a860113200766575/groups/19adf8a47c284786b72e4a5615ffd44d/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:55.090435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656857c8-cb6c-418b-8805-88e629131812 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.090961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656857c8-cb6c-418b-8805-88e629131812 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.091513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656857c8-cb6c-418b-8805-88e629131812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.110607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-656857c8-cb6c-418b-8805-88e629131812 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:55.112212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-656857c8-cb6c-418b-8805-88e629131812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:55.160601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6f44-aa02-40cb-a784-efc471cac9e9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.196873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 222/413] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:55.200080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.200823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.201154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.201432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.202306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.202615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.204081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.215508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 192/414] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:55.220764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656857c8-cb6c-418b-8805-88e629131812 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.221101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.326961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656857c8-cb6c-418b-8805-88e629131812 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.327365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b50a2-73f0-4580-936e-0001dbfc3e85 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.364932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.365510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.366025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.366305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.366576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] PATH_INFO: `/v3/groups/a916c1eedafc4d54996683a4e121e44c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.367241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.367711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.367811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] RBAC: Authorizing `identity:get_group(group_id=a916c1eedafc4d54996683a4e121e44c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.368275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.369517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.376774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 193/415] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/groups/a916c1eedafc4d54996683a4e121e44c => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:55.377747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.382128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:55.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.391038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:55.391932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:55.396115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 223/416] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:55.401158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.482870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd365-3ccc-4584-94a7-1dfb182798c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.508125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6d9d-1545-4461-bae9-c0c35b0e33a7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.546403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.547409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.547889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.548379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.549526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.550233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.551888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.565356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 224/417] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:55.565952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.566826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.567154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.567423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] PATH_INFO: `/v3/projects/2e1554fd89594f468faedf42d5357b2f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.568526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.573423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] RBAC: Authorizing `identity:get_project(project_id=2e1554fd89594f468faedf42d5357b2f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.574882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.580629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 194/418] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/projects/2e1554fd89594f468faedf42d5357b2f => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:55.584183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.693853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacb3f-e311-4e98-a84a-9a0a41790996 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.731507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.733546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.734058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.734529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] PATH_INFO: `/v3/projects/2e1554fd89594f468faedf42d5357b2f/groups/a916c1eedafc4d54996683a4e121e44c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.736719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] RBAC: Authorizing `identity:create_grant(project_id=2e1554fd89594f468faedf42d5357b2f, group_id=a916c1eedafc4d54996683a4e121e44c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.738624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.767673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 195/419] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 10 03:00:55 2022] PUT /identity/v3/projects/2e1554fd89594f468faedf42d5357b2f/groups/a916c1eedafc4d54996683a4e121e44c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:55.784549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa07b-9f24-4401-9de6-f3e6c40d7d61 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.822825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.823919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.824446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.824987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.899565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.901472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.010223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 225/420] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:56.012466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.127093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881c4c-f71a-46ae-9f69-74cfd86172cf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.170411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.171702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.172183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.172766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.174310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.176016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.183051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 196/421] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.184720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.287841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58f27-b180-4796-a5df-34ad1621f5bf None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.321265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.322491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.322969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.323463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.324869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.326496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c8d28-b960-4c29-bd54-40fdde10a055 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.333132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 226/422] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.335321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.359451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d51e7-e027-4819-8068-7295418552e8 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.359838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d51e7-e027-4819-8068-7295418552e8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.360116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d51e7-e027-4819-8068-7295418552e8 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.363344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 227/423] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:56.367647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.368011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.368394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.385133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:56.386293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:56.463100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 228/424] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:56.490398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.508293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774a51c-6a58-48fc-9cb7-8cc1c84663cf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.574850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.575425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.575703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.575973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.576821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.577126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.578556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.592147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 197/425] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.641023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b5e52-738b-4ef2-b838-7b6938691af3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.684611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.685519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.685798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.686069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.705782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:56.714864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:56.715834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:56.716933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 229/426] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:56.721969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.827257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef124d-2e55-46c6-9fb3-a05ecf4e8ff3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.863568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.865185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.865649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.866095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.867060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.867542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.869149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.878671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 198/427] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:56.886782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.994116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010ee4-d8f3-43cf-a2f4-47b50c6fc2c2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.028327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.029008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.029288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.029563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.099604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.101014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.200593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 230/428] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:57.205822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.316565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fd29b-2171-4a94-9d8a-56131cdc2972 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.359105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.359105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.359105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.359105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] PATH_INFO: `/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.359478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] RBAC: Authorizing `identity:get_project(project_id=55d6ba97f32c4ea5b957d2d6e1852cda)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.359866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.362097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 199/429] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/projects/55d6ba97f32c4ea5b957d2d6e1852cda => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.369876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.478353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6811-48ba-4c40-bc2e-2e148f903a5d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.516800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.517660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.517983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.518256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.519440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.521334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de35a-7ace-4efc-87c9-0d6f57f6ea0c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.523309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 231/430] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.530185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.642400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6cb19-dbda-44bc-ab43-3fd0e728d0bd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.681294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.682287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.682788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.683268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.684304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:57.684903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.686462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf767-39ff-45da-9628-48bc7af87456 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.686616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.687107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf767-39ff-45da-9628-48bc7af87456 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.687584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf767-39ff-45da-9628-48bc7af87456 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.690540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 232/431] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:57.694309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 200/432] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=55d6ba97f32c4ea5b957d2d6e1852cda&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.697800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6152-b971-44ab-8c91-8ea6b3775f58 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.698380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6152-b971-44ab-8c91-8ea6b3775f58 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.698860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6152-b971-44ab-8c91-8ea6b3775f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.720717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-900f6152-b971-44ab-8c91-8ea6b3775f58 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:57.722389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-900f6152-b971-44ab-8c91-8ea6b3775f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:57.799718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 233/433] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:57.824038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.916816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a67b-6896-4a9f-af19-afcd82a3a401 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.917107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a67b-6896-4a9f-af19-afcd82a3a401 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.917302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a67b-6896-4a9f-af19-afcd82a3a401 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.918671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 234/434] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:57.924407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.924729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.925247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.944872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd06d7-9d00-4c59-a11b-7cf1ee179e1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.953835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:57.956486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:57.982522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.983334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.983613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.983924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.996269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:58.005101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:58.006170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:58.006960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 201/435] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:58.012119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.049373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 235/436] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:58.072352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.150013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4154-76d6-498e-843c-eb2c3abc772d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.194085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.194413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8d37-cdda-4aa8-b29b-43c80970f36a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.195318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.195815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.196195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.197109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:58.197483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.199874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.209870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 202/437] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:58.215439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.235463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.236876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.237291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.237574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.250812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:58.258642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:58.259777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:00:58.260600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 236/438] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:58.265336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.325577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d974b-14cd-48b9-95b7-645d2d334aa7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.361064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.361961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.362394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.362664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.365405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcad18-1461-4cb0-83d9-40cdeadb11c2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.406573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.407897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.408619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.409106 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.410200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:58.411343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.412997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.422209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 237/439] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:58.427582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.439668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.441171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.522822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b40f-027e-43bc-88e7-7632056f6e03 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.541844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 203/440] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:58.547269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.555935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.556580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.556904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.557189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.621189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.622618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcff497-7bd0-4b0d-aeb2-4b3093e132f7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.640077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912599-0b2d-4a35-ac14-f5f3362f7540 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.677360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.678227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.678508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.678784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.680053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.681529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1eae2-6555-4740-99a3-09baf612fa23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.684933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 204/441] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:58.686159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e670-4782-44d3-984a-166f0fe3eda9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.686445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e670-4782-44d3-984a-166f0fe3eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.686716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e670-4782-44d3-984a-166f0fe3eda9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.688105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 205/442] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:00:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:58.690428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e670-4782-44d3-984a-166f0fe3eda9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.716145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 238/443] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:58.717435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.717716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.717984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.735215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:58.736384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:58.786611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e670-4782-44d3-984a-166f0fe3eda9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.798644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 239/444] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:58.799457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.819329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.820236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.820434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.820726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.822067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.823496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.825175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 206/445] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:58.825895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.892386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345025c0-2f93-4411-a0ac-acc17b9e5cd3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.919377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff35-2ced-450b-ad15-fb6ee8e8f676 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.924295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.925169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.925447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.925713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] PATH_INFO: `/v3/projects/f7e7f8f0018a4824a860113200766575` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.927117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e7f8f0018a4824a860113200766575)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.928586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.930278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 240/446] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/projects/f7e7f8f0018a4824a860113200766575 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:58.931030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.951122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.951901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.952170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.952433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.962603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:58.970102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:58.971093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:00:58.971890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 207/447] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:58.973655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.025850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e526-c724-4ad7-b6bb-4fc7fd29c0d3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.059802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.060503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.060647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.060946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.061773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=f7e7f8f0018a4824a860113200766575) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.062084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.063502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.068719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910656b1-f1d6-4df0-bc18-446c246ed2a4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.071311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 241/448] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.072097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.103965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.104881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.105163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.105443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] PATH_INFO: `/v3/groups/19adf8a47c284786b72e4a5615ffd44d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.106695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] RBAC: Authorizing `identity:get_group(group_id=19adf8a47c284786b72e4a5615ffd44d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.108184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.110094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 208/449] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/groups/19adf8a47c284786b72e4a5615ffd44d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.116764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.183132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4f9c-f9a7-4640-86c3-7fcd20324e59 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.218283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.218961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.219243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.219522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.220280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.220584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.221999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.222701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3045-06e4-4357-8ccf-bd1419e21e16 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.235641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 242/450] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.236870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.259119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.260024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.260299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.260576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.261451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] RBAC: Adding query filter params (group.id=19adf8a47c284786b72e4a5615ffd44d, role.id=adc3123199d941ea88fc13d1bb807ff1, scope.project.id=f7e7f8f0018a4824a860113200766575) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.261756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.263181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.271002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 209/451] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/role_assignments?group.id=19adf8a47c284786b72e4a5615ffd44d&scope.project.id=f7e7f8f0018a4824a860113200766575&role.id=adc3123199d941ea88fc13d1bb807ff1 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:59.350233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1567-8f4d-47a6-a4f2-3391a0b9b518 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.386630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.387298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.387583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.387859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.455589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.457085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.553704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 243/452] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:59.559395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.656149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3fb1-af3c-42bf-97c9-3d8b75953433 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.689755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.690612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.690892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.691164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] PATH_INFO: `/v3/projects/2e1554fd89594f468faedf42d5357b2f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.692466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] RBAC: Authorizing `identity:get_project(project_id=2e1554fd89594f468faedf42d5357b2f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.693931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.695618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 210/453] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/projects/2e1554fd89594f468faedf42d5357b2f => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.701292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.798069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbd3-eace-47c6-87da-0c11ac979be4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.829628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.830458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.830736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.831006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] PATH_INFO: `/v3/groups/a916c1eedafc4d54996683a4e121e44c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.832145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] RBAC: Authorizing `identity:get_group(group_id=a916c1eedafc4d54996683a4e121e44c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.833697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b641476-50a8-4efc-8105-65f759635427 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.835271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 244/454] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/groups/a916c1eedafc4d54996683a4e121e44c => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.841059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.932970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212d27f-8443-4440-959a-958909fc4c91 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.964554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.965222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.965504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.965778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.966602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] RBAC: Adding query filter params (group.id=a916c1eedafc4d54996683a4e121e44c, role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=2e1554fd89594f468faedf42d5357b2f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.966912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.968337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67148aa-8678-401f-b4d1-234311643773 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.974951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 211/455] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/role_assignments?group.id=a916c1eedafc4d54996683a4e121e44c&scope.project.id=2e1554fd89594f468faedf42d5357b2f&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:02.847137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac867-3d93-42ac-8f3f-eae56159e5d0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.847650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac867-3d93-42ac-8f3f-eae56159e5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.847830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac867-3d93-42ac-8f3f-eae56159e5d0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.849418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 245/456] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:02.859671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce8db-cefc-4383-a1c5-a180c047d71a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.860531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce8db-cefc-4383-a1c5-a180c047d71a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.861039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce8db-cefc-4383-a1c5-a180c047d71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.877337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a3c-6762-43dc-9fde-15aca136d857 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.877942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a3c-6762-43dc-9fde-15aca136d857 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.878421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a3c-6762-43dc-9fde-15aca136d857 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.880615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 246/457] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:02.887153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.887435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.887711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.896904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7f7ce8db-cefc-4383-a1c5-a180c047d71a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:02.898090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7f7ce8db-cefc-4383-a1c5-a180c047d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:02.919148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:02.921268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:02.982937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 212/458] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:02.984519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd00-0618-417e-89dd-9832adb1e157 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.984970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd00-0618-417e-89dd-9832adb1e157 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.985387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd00-0618-417e-89dd-9832adb1e157 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.987017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 213/459] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:02.996676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.996676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.996676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.011679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:03.012879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:03.016631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 247/460] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:03.017713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.084491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 214/461] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:03.093445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.124574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a0d7-3f8f-4b91-bf7d-18728b8fccc7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.163866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.164984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.165411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.165859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.178620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.180359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:03.201207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:03.202318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:03.203282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:03.203282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:03.203282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.203282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:03.205140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 248/462] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:03.211208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.218247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621fd94-46eb-4e65-9876-f57c6e4133ab None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.252488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.253298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.253779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.254255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.265140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.266772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:03.284837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:03.286721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:03.287775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:03.287775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:03.287775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.287775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:03.289635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 215/463] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:03.290558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.327062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08144-4e13-4c62-919e-fcca5f297076 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.367467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.368262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.368543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.368847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.379063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.381145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.394189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87ec39-fa08-42a9-8b98-fbbb2cd1baa8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:03.398568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:03.399410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:03.400250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:03.400250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:03.400250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.400250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:03.404813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 249/464] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:03.405513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.430817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.431693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.431976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.432254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.433005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.433309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.434664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6169b7-a6d9-47a7-9463-a68caca7ccc6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 216/465] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418792-c05d-4645-883d-61f09f805866 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418792-c05d-4645-883d-61f09f805866 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418792-c05d-4645-883d-61f09f805866 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 217/466] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:03.450839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418792-c05d-4645-883d-61f09f805866 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.511607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b998b5d-e454-42b3-ab69-3b8524c2de23 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.546133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.546906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.547200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.547480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.548207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.548516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.549922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.553804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418792-c05d-4645-883d-61f09f805866 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.573049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 250/467] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:03.573049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.594068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.594736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.595018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.595300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.596109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.596296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.597685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14af0-21fd-4309-b111-24600726db71 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.609060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 218/468] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:03.610328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.610617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.610894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.627309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:03.628488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:03.670385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173dfc-772a-41c5-aab9-6aac2dbcba6b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.703905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.704574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.704934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 219/469] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:03.705040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.705213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.705630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.705874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.707483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.736700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 251/470] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:03 2022] POST /identity/v3/users => generated 248 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:03.736700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.840533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0a0b-170c-4fdf-becb-774424cc95e8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.845706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fea5ac-53dc-4943-b83a-44e76b077a75 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.877009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.877775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.878129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.878474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.879796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.881331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.884129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.884989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.885369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.885758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.886573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.888123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.904629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 252/471] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:03 2022] POST /identity/v3/users => generated 248 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:03.905534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.923768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 220/472] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:03 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:04.042861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5089da-6d2c-46ae-8788-dd1dc1efcb9d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.084598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.085456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.085738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.086005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.099611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.101150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d239cef7-fb4b-437a-b0dd-d555d61926f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:04.120942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:04.121864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:04.123160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:04.123160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:04.123160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:04.123160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.123160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 253/473] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:04.128446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.244400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbbdc7-ceaa-4d12-b201-605fe45d1977 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.277041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615f01-876c-4093-ae19-5ce19458bf61 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.277780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615f01-876c-4093-ae19-5ce19458bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.278517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615f01-876c-4093-ae19-5ce19458bf61 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.280366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 254/474] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:04.284403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.284403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.284403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.284403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.284761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:04.284761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.285565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.286886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.287391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.287667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.299791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 221/475] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:04.305391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:04.305629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.306965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:04.382740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 255/476] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:04.405480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.420804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9658ce-941b-4c56-91e0-89ab58dbabdb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.456180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.457810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.458367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.458898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.459834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.461471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.496997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 222/477] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:04 2022] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:04.532596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9284ae-0a94-4e53-af2d-7200871cf43d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.573207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.574376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.574947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.575418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.576528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.578265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.587563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.sql.core [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:01:04.587563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 03:01:04.587563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [parameters: {'id': '5104a7ceaba04575a32969198380bed2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 03:01:04.587563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80056) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result.read() May 10 03:01:04.606543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return ref.to_dict() May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:04.607457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application yield resource May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise self.value May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application session.commit() May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:01:04.608411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.session.flush() May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application compat.raise_( May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:01:04.609296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:04.610851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result.read() May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:04.611644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [parameters: {'id': '5104a7ceaba04575a32969198380bed2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:04.612409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 03:01:04.613286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:04.618249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 256/478] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 10 03:01:04 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:04.624403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.741506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceb40-aa21-423b-ad19-3766e7ba6dac None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.797420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.798217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.798503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.798781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.813061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f365c3f9-9331-47b5-a1a3-fe6ceea39cd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:04.821315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:04.822200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:04.822984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 223/479] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:04.829716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.936301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ebd1-8e9a-458d-8b4b-dfe81cf4703f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.970578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.971593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.972088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.972550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.974051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:04.974569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.976113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda42f6-e900-4ad4-aedf-aa981526b8cb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.985285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 257/480] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:06.638973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc814b3-d4b3-4bc2-b916-54a4433e8a83 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.639529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc814b3-d4b3-4bc2-b916-54a4433e8a83 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.639529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc814b3-d4b3-4bc2-b916-54a4433e8a83 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.640898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 224/481] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:06.648027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.648521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.648623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.668554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e255-d571-4319-b937-4ba74f7ec9d2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.668890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e255-d571-4319-b937-4ba74f7ec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.669140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e255-d571-4319-b937-4ba74f7ec9d2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.670511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 225/482] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:06.677221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.677221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.677445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.681646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:06.683031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:06.703158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:06.704336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:06.799755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 226/483] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:06.807135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 258/484] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:06.819903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.830315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.938355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22876042-f3c5-405a-a299-69d0fd2d15f2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.955978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014754b-972e-4146-81e2-b8b5a90bb88c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.975327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.976439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.976983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.977458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.989600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:06.990151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.990936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.991215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.991487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4a3ec9b4-d2c2-4f1f-89b5-c433c319711e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:06.999815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.000711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:07.001518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:07.002690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 259/485] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.003481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a813b-1b73-4541-a6f9-63b09fcb2771 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.003764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a813b-1b73-4541-a6f9-63b09fcb2771 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.004575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a813b-1b73-4541-a6f9-63b09fcb2771 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.005975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 260/486] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:07.009695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:07.011591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a813b-1b73-4541-a6f9-63b09fcb2771 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7b91657f-408f-433a-b9f2-cf0775835c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:07.021772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.022670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:07.023469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:07.026539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 227/487] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.028533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.029195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.029726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.052945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:07.054349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:07.132688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a813b-1b73-4541-a6f9-63b09fcb2771 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.153246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 228/488] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:07.153246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.189040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.189637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.189916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.190189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.190930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.191234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.193377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.209058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 261/489] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.210725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.281755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094996c-d159-4612-b3f3-f61de8dde377 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.325390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.326606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.327332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.328101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.329336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.329822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.333019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.336913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b416c9-b2c2-484d-8d31-00300699bf47 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.344080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 229/490] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.345722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.383464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.384270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.384542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.384878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.401696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:07.413377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.414313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:07.415113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:07.420544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 262/491] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.421840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.490740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c078-4683-456a-b45d-7b0671b9905f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.528064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.528896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.529179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.529453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.530323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36f40-e5de-45d9-ac77-fe5d4c2d4aec None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.540890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.542340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:07.562067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.562975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.563812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:07.563812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:07.563812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.563812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:07.564792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 230/492] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.565807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.571533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.572609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.573121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.573610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.585749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.587476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:07.605332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.606198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.607065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:07.607065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:07.607065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.607065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:07.609267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 263/493] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.610327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.684321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ce046-8714-4391-9e42-db2c42b00149 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.714876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b53f2-6d41-4f88-b5d9-e1a11bc7fe66 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.723711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.724972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.725813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.726565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.727513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.728142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.730395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.740963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 231/494] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.742533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.749059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.749588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.749873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.750194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.750918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.751274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.752634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11c38d-57a6-4611-bbdb-66930c130bdc None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.765621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 264/495] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.766924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741cff-f576-4d5f-9623-a6e19d12f271 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.767209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741cff-f576-4d5f-9623-a6e19d12f271 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.767484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741cff-f576-4d5f-9623-a6e19d12f271 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.768792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 265/496] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:07.769484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741cff-f576-4d5f-9623-a6e19d12f271 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.853250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1e9d-9705-4dc6-b078-ff8c3e571401 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.872002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741cff-f576-4d5f-9623-a6e19d12f271 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.884758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.885396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.885682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.885953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.886662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.886963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.888312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.899558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 232/497] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.900328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.908970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.909836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.910670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.911472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.921303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.922745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-ed0c9b2a-6eb8-4a62-b45a-7bab84aae265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:07.940538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.941396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.942229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:07.942229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:07.942229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.942229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:07.942453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 266/498] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.943585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88206f0a-297b-460f-be6e-35705f348c59 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.943875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88206f0a-297b-460f-be6e-35705f348c59 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.944157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88206f0a-297b-460f-be6e-35705f348c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.960041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-88206f0a-297b-460f-be6e-35705f348c59 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:07.961361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-88206f0a-297b-460f-be6e-35705f348c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:07.997196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205fc1-95e5-4e57-94ec-6f48482e49a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.025460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 267/499] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:08.026599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69c86-5d7e-4f38-829a-354aa52b5ad0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.026891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69c86-5d7e-4f38-829a-354aa52b5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.027161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69c86-5d7e-4f38-829a-354aa52b5ad0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.028927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 268/500] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:08.029383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69c86-5d7e-4f38-829a-354aa52b5ad0 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.033352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.034144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.034420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.034685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.044506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.045998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:08.063067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.064127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 233/501] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.065105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.130859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69c86-5d7e-4f38-829a-354aa52b5ad0 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.162810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb52f75-aa4c-40a9-b6bd-6b9a15cc4305 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.163636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.164412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.164709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.164978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.171673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.173137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-5820cf71-dbcd-46bb-a545-ae2036cdd522 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:08.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.189103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:08.189994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 269/502] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.190684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.191176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.191176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.196110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.196797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.197075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.197340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.198056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.198357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.199722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.208737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:08.209901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:08.211225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 234/503] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.212013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.272717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 270/504] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:08.273477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.307569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da428-e8a9-4b70-8a0c-03da67623df8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.339241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.340160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.340441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.340747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.350299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:08.357983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.358858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:08.359858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 235/505] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.360702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.368251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2d287-1d36-40a2-bd03-574085d6da46 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.399633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.400291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.400567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.400862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.401687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.401985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.403677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.438889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 271/506] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.439720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.454628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb1d66-5520-4570-91fe-705de8a2e931 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.487139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.487798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.488078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.488354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.489229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.489535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.490962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.526844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 236/507] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.527585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.534168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b002f-3728-4781-b63f-5678e1c39547 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.565947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.567449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.567729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.568003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.574864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.576303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:08.590898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.591862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 272/508] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.592801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.623528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bf81-b6f1-4388-a2ea-b3b971ddf52d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.656233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.657045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.657325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.657599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.667076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.668518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:08.686622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.687928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.688809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:08.688809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:08.688809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:08.688809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:08.689018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e949-41fb-4b27-889c-d5ae552b3b40 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.689090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 237/509] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.689090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.720780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.721433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.721712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.721987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.722746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.723052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.724405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.731951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 273/510] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.732749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.782588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171c598-a13a-40bb-9739-2c185355a0ba None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.813430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.814059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.814333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.814606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.826230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf700-18a3-4ba7-96f4-491adde4b91f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.857452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.858090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.858367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.858647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.878595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.880785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.921871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.923303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.972137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 238/511] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:08.973180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.015809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 274/512] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:09.016639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.076249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49d88-cf30-4988-89c2-358470f28b3e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.107745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.108363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbafa9-6b10-4802-936a-ef5f5492d37a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.108473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.108689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.108960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.109791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.110092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.111534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.128100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 239/513] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.129464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.141038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.141694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.141974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.142246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.142961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.143262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.144765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.155463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 275/514] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.156236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.230081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92392-90e0-4fa4-99cf-b94f51872afc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.256496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f61b-6a43-41b0-8b2f-59ece18873ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.263969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.264799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.265080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.265354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.275370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.276873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.288613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.289423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.289702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.289972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:09.295211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:09.296165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:09.297271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:09.297271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:09.297271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.297271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:09.300237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.301420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 240/515] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:09.302386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.302526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:09.319944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:09.320841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:09.321676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:09.321676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:09.321676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.321676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:09.321676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 276/516] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:09.321947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.398714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3b90-b40e-49bd-8ee0-2279768d9e62 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.418643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24b40-73db-4223-8cf4-9d258ce8e970 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.429981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.430753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.431029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.431295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.440643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.442642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.450714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.451349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.451629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.451902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:09.461694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:09.462527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:09.463368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:09.463368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:09.463368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.463368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:09.463368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 241/517] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:09.463632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.516583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.518067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.557539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4979b-2d87-4437-be2b-b1c1a78f796a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.589066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.589657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.589937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.590211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.590908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.592332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.610997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 242/518] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:09 2022] POST /identity/v3/users => generated 247 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:09.617082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 277/519] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:09.617266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.617344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.718485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbad7a-2e76-4ac5-ab62-b6106b323fd6 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.722461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a2b4f-5f44-41fd-89c6-d1afa759f1d0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.754976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.755663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.755943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.756210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.757016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.757276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.758658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.759525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.760178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.760452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.760747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.761479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.761786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.763172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.771437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 278/520] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.772074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.778209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 243/521] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.779485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.877538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee98dc-702b-43be-80cf-680565686f2a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.889581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f643be-d64c-4909-8a4c-51bf2cfbc521 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.911246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.912138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.912416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.912718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.913438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.913742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.915093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.926654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 279/522] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.927550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.932929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.933731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.934009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.934276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.944396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.945868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:09.963227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:09.964086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 244/523] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:09.965545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.026913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98ec7-724f-4f45-9829-c3464f940b33 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.062709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.063600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.063926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.064271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.070280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d582e4-d8cd-47ae-b013-5e2fa6604ab8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.071475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.072928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:10.088116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:10.089177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.090198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:10.093541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 280/524] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.094069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.108176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.109007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.109278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.109541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.116985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.118441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:10.133222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:10.134311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 245/525] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.135389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.195228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc41c7a-810c-4b5b-9122-bd96f7ea94ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.227603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.228487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.228797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.229066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.235622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.237079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.238042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fefca8-c984-4086-a101-21ec3d129947 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:10.251018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:10.251916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 281/526] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.253725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.273771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.274425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.274701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.274966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.275673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.275969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.277354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.289577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 246/527] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.290368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.358789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde978b4-730e-47b1-9fde-18db9cc0a10a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.391595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40a2e-63fe-40bf-82cd-17e9a22f2dbe None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.393871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.394675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.394964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.395281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.396006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.396309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.397773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.415537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 282/528] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.416643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.426561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.427226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.427503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.427772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.428604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.428932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.430384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.447936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 247/529] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.448772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.521398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c49d-80c4-4150-ae0d-ad139ca521ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.546387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb259d82-8a1c-4e85-a554-4db3a5502f5c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.554384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.555042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.555321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.555593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.556369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.556702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.558126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.569887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 283/530] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.570582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.579565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.580617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.581138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.581601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.588465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.589986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:10.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:10.604642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:10.605524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:10.609511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 248/531] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.610099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.665609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823b6f-142f-43b2-907d-05ee0474fe86 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.698541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.699191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.699468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.699739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.700559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=e2e8a60a8ef644e691a9a501ad2a4104) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.700956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.702291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.705526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16117ff-b58c-4fe7-91cb-212d85a0075d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.708923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 284/532] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/role_assignments?user.id=e2e8a60a8ef644e691a9a501ad2a4104&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.709220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.751107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.752487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.753061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.753552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.820845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3da92-c120-46f8-9bd6-d31e7ad43e91 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.831110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.833875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.856420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.857129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.857408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.857681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.858911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.858911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.860323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.866882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 285/533] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.867845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.949911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 249/534] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:10.960867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.981879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa4eb-e426-4946-949a-dd0023d75fc9 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.018018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.018694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.018974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.019248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.020178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.020588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.022208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.040810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 286/535] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.042150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.078935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acfc1e-e681-42b6-ad8b-0fda7360f68a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.140027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.141186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.141687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.142152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.156676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39026f2a-a0ff-408b-8ed5-715b32882c7a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.161911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.163594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.184398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.185074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.185353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.185623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.186440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=5afe79ba075a4f4da308f8d982d00869) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.186746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.188172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:11.198470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:11.199432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:11.200323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:11.200323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:11.200323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:11.200323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:11.208778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 287/536] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/role_assignments?user.id=5afe79ba075a4f4da308f8d982d00869&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.209766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.210497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 250/537] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:11.315337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311864-ad1e-4f05-ac56-4dc733e958ab None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.351417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.352087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.352371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.352644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.353396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.353698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.355055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.367912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 288/538] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.373535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.517935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efd09-68e5-44a7-b483-fb2d151b10a1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.568608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.569430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.569707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.569977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.577831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.579272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:11.596968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:11.598387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:11.599413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 251/539] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:11.609764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.734801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adde46-eeb6-4d5c-a728-f285998279e4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.770639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.771224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.771505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.771776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.772616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.772947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.774382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688035-8c62-4d24-af93-84e2d295f46a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.787509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 289/540] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.793248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.906247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a10c7-c7eb-4b30-ac07-298a8103ee5d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.943254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.943912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.944193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.944463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.945330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=b14194021b484ce884af2c593d59e54e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.945639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.947115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889122-9d96-44a6-8db1-5a08a89bc10d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.953797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 252/541] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/role_assignments?user.id=b14194021b484ce884af2c593d59e54e&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:12.143131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d080-748f-4947-b4ae-d7f56355e1ad None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.143987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d080-748f-4947-b4ae-d7f56355e1ad None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.144981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d080-748f-4947-b4ae-d7f56355e1ad None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.146574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 290/542] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:12.158790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.159078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.159358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.185856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:12.187113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:12.267404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 253/543] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:12.315798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d080-748f-4947-b4ae-d7f56355e1ad None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.462328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d080-748f-4947-b4ae-d7f56355e1ad None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.504295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.505395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.505821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.506239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.521771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:12.529920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:12.530995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:12.531986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:12.538431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 291/544] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:12.544402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.692757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f3302-3137-498e-87cb-77edf21ca002 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.734301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.735229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.735651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.736065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.736971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.737414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.739169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.751482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 254/545] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:12.757110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.880623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7195bd-cd15-49a6-9046-5c42ce80ada8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.926816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.927611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.927886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.928153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.942050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.943735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:12.965172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:12.966051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:12.967562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:12.967562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:12.967562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:12.967562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:12.967562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 292/546] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:12.971830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.103518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db817ef7-0c13-482e-a02e-4a47d9fdc9f4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.143667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.144644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.145013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.145288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.146015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:13.146318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.147673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.160600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 255/547] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:13.165920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.299335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f2dd-0fd1-4430-9b98-d7d48d692c5a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.339609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.340410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.340706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.341035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.349675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.351107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:13.371621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:13.372568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:13.374545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 293/548] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:13.379248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.515636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80d99-1485-46f4-a563-2d24d9df76b3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.555711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.556736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.557256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.557803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.558826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:13.559322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.560957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a338f2-b79c-4603-9d85-bb8cc02f5058 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.583487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 256/549] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:13.589406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.725766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa928-94d5-4cd6-a0b8-92581424f174 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.726440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa928-94d5-4cd6-a0b8-92581424f174 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.726819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa928-94d5-4cd6-a0b8-92581424f174 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.728639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 257/550] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:13.732866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bea8-0cff-442f-926f-bb973bc97a08 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.735145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ab54-48e1-4519-8ec0-5a5a3febe30e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.735435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ab54-48e1-4519-8ec0-5a5a3febe30e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.735708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ab54-48e1-4519-8ec0-5a5a3febe30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.766639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b907-b645-4004-b324-e77795416fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.767293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b907-b645-4004-b324-e77795416fde None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.767576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b907-b645-4004-b324-e77795416fde None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.767852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b907-b645-4004-b324-e77795416fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.775896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a153ab54-48e1-4519-8ec0-5a5a3febe30e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:13.777433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a153ab54-48e1-4519-8ec0-5a5a3febe30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:13.837784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b907-b645-4004-b324-e77795416fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.839155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b907-b645-4004-b324-e77795416fde None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.873270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 258/551] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:13.874683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195ee9-7613-4785-906e-421a5851fe7a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.874972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195ee9-7613-4785-906e-421a5851fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.875246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195ee9-7613-4785-906e-421a5851fe7a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.876813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 259/552] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:13.883791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.884075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.884681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.906830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:13.908485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:13.955735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 294/553] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:13.956762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b907-b645-4004-b324-e77795416fde None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.996741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 260/554] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:13.997687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.090382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b907-b645-4004-b324-e77795416fde None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.120278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05f140-2dc7-4086-aee9-dc3b045a9943 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.135208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.136166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.136444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.136739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.150902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:14.157755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.158706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.159126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.159535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:14.160577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.161641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.162503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:14.166818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 295/555] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.167646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.175931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.177670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:14.195393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.196253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.197397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:14.197397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:14.197397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.197397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:14.199215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 261/556] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.200337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.286374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8fb8-33c1-4344-872d-0e78fbde7491 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.313429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be40-91e1-4524-add3-ce724a99dad5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.320812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.321615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.321899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.322177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.333064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:14.340756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.341631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:14.342435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 296/557] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.343175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.352405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.353106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.353389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.353686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.354444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.354782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.356144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca293-c398-4344-a308-45729bba6ba8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 262/558] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d86d6-4939-478c-9cd2-c9a44ea675b6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d86d6-4939-478c-9cd2-c9a44ea675b6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d86d6-4939-478c-9cd2-c9a44ea675b6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 263/559] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:14.369802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d86d6-4939-478c-9cd2-c9a44ea675b6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.452799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eaddf-f0d6-42af-9198-2dde2e49996a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.467888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d86d6-4939-478c-9cd2-c9a44ea675b6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.485250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.485906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.486190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.486467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.487181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.487487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.489264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.499442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.500099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.500376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 297/560] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.500470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.500669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.501193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.501406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.501711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.503061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e05335-e01b-442d-9d40-e55624b6c37a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.512698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 264/561] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.513496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be83c-76a9-4098-ae05-68e495522f35 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.513782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be83c-76a9-4098-ae05-68e495522f35 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.514056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be83c-76a9-4098-ae05-68e495522f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.531650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2f4be83c-76a9-4098-ae05-68e495522f35 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:14.532855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2f4be83c-76a9-4098-ae05-68e495522f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:14.594222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 265/562] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:14.594626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97b06-3850-49ef-bdd5-083271f0778b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.595489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c45db-97c2-4cba-9d67-206c79c33bee None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.595769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c45db-97c2-4cba-9d67-206c79c33bee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.596045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c45db-97c2-4cba-9d67-206c79c33bee None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.598127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 266/563] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:14.598731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c45db-97c2-4cba-9d67-206c79c33bee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.630931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.631747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.632023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.632291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.641948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.643374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:14.660957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.661793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.662628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:14.662628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:14.662628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.662628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:14.662628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 298/564] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.662886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.702572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c45db-97c2-4cba-9d67-206c79c33bee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.733820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.734598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.734877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.735148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.742355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.743776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-17a14f03-4790-4fa3-8be9-209085ab001f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:14.757159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.758589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:14.759586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:14.759992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2103c-140f-442e-887c-c2a6c5ba10d9 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.760072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 267/565] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.760072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.760072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.760346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.775739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:14.776927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:14.794986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.795767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.796052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.796323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.806429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.807844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:14.824685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.825726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 299/566] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.831460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.838716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 268/567] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:14.839535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.924104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dda99-852c-474e-8c75-fc8e69122f40 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.932415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d03e5-afb2-49ae-a727-4270315581ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.956402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.957873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.958152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.958428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.964523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.965209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.965487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.965757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.966470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.966771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.967959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:14.968134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:14.976162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:14.977150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:14.977962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 300/568] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:14.978713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.980116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 269/569] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.980935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.077986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2eca8-61c9-4302-a039-55b7cdf358c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.078544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695147-de5f-4caa-ada1-9bf15ed089ab None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.109122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.109767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.109911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.110045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.110320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.110409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.110684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.110958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.111091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.111398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.111677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.111980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.112862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.114454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.124861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 301/570] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.125455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.125974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 270/571] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.126867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.221040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db843e6-52ec-4a27-a461-e7334beabe1d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.222106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6287-528e-4ff3-9084-b4ccca34100e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.252815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.254136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.254487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.254761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.256193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.256892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.257176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.257449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.258194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.258496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.259868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.264542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:15.267741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 271/572] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.268523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:15.272778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.274046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:15.274931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 302/573] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:15.275602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.362459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9ca3-44ff-4193-aeb8-36f32de80723 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.369186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397b5b-cbe7-475f-8f9d-344dad83cee3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.394012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.394821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.395096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.395363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.399818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.400601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.400920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.401187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.402556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.404255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.408590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.410690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:15.418314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.419406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 272/574] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:15.420443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:15.424305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.425292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 303/575] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:15.426867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.514186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d448a-d21f-48ea-a216-1114e999f910 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.519044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae304-c13c-4bd3-b57d-7ef47f72844f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.545809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.546451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.546735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.547005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.547822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=40e88dcd650d4783979ca3fd848203bd) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.548132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.549591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.551366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.552145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.552424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.552718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.555623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 273/576] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/role_assignments?user.id=40e88dcd650d4783979ca3fd848203bd&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.556401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.563314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.564937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:15.583232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.584247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 304/577] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:15.585790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.687805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324168e-29c2-48ef-8530-673f301f32d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.705538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db56bfa-3ff5-4265-b342-ff356228f573 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.730887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.731556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.731839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.732644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.732879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.733182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.734563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.743456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 274/578] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.744314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.746887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.747596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.747836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.748107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.749113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.749319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.750762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.769044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 305/579] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.770683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.845833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f208-8dac-429d-8dbc-f2927d2bb0dd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.866513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390070b-2b0f-4ab1-ac8a-3cc980fc08ea None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.880924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.881588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.881863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.882137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.882982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.883256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.884692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.899450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.900114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.900392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.900688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.901406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.901709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.903316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.906673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 275/580] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.907556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.915296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 306/581] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.916445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.006387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17ace-47b0-4753-a9a5-2ffd1d6923b0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.015194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605076-fa9a-41f9-a520-085e196bdbfb None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.040002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.040810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.041019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.041292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.054655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.055585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.056105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.056836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.057125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.057404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.070576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.072034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:16.076905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.077776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.079081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:16.079081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:16.079081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.079081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:16.080958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 276/582] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.082672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:16.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.091749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.092621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:16.092621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:16.092621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.092621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:16.092621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 307/583] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.093708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.190797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c98fc-633d-467f-9ae9-b56dcbe78af0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.191553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c57967-19e6-4735-ad6e-d92e8d3cd24f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.225283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.225953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.226202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.226305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.226380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.226555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.226649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.226792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.234303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.235720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.238566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.240006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:16.250469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:16.252466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 308/584] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.254090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:16.262469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.263331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.264213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:16.264213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:16.264213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.264213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:16.268090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 277/585] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.268757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.356037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb3eb-3122-4605-a1ae-654ebd0bf25d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.366698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d443d6c-093b-430b-a97c-efdc679a0dd6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.390557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.391222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.391532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.391781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.392499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:16.392837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.394238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.401226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.401881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.402159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.402429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.403401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:16.403700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.405080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.410636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 309/586] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:16.410636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.424893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 278/587] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:16.424893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.514295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379299dc-1ae0-4c0b-9ae4-ad84c55e48fb None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.517611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaefbf1-3da6-4776-a9e2-5e021039e129 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.547221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.547978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.548258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.548529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.549381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:16.549745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.550850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.551600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.551833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.552114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.552387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.553140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:16.553443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.554857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.571109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 279/588] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:16.571109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.572605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 310/589] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:16.573410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.669136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6031d4b-13c9-4bac-a027-be2a51cdf730 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.674360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334139-03f7-4b5b-a893-3a82e6749cd7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.702145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.703214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.703706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.704052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.708089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.708913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.709193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.709463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.711322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.712795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.716422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.717891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:16.727156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.728071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:16.729381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 311/590] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.729872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:16.737349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.738390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:16.739310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 280/591] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.741643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.829386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5633-c1ba-486d-9ddf-d9e0b622cf43 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.833370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa75ed-400a-4d6f-9597-ff16f7af138e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.863519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.864334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.864616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.864914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.869329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.870120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.870399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.870669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.871943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.873462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.880242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.881677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:16.887423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.888258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:16.889250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 312/592] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.889734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:16.903894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.905030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 281/593] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.907191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.998869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c0b5-0385-4638-8144-d1be8c7774f6 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.005419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688342-dbdb-41be-9c9e-31f3670be152 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.031251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.031913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.032175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.032447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.033252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.033562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.035530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.038987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.039641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.039919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.040187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.041042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.041345 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.042747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.047878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 313/594] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.050026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.071466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 282/595] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.072484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.151775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffd52-23d2-486a-949f-e0d453c21896 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.167266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad516-efc0-46e0-9f57-39b7f306ec05 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.184711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.185370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.185651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.185926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.186708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.187016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.188434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.199088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.199744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.200019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.200287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.205597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 314/596] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.205725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.205725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.205883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.205953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.218389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 283/597] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.218389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.307406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df35d92-4c8a-4dcb-9069-e63e91b51afc None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.319189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d157c6d-6d63-4510-8fba-cb063197fde6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.349773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.350653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.350933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.351197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.353424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.354734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.354734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.354734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.366632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.366802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=a3fa3765319b4024ab300ae52161d649, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.368117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.368221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.382171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 315/598] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:17 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:17.383266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:17.387207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:17.388114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:17.389037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:17.389037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:17.389037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:17.389037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:17.389037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 284/599] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:17.389734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.509262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380c7b0-e928-4481-aa9f-4c03fbb8a49c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.534655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e023bb-74c6-4c37-9fdd-78974b16d387 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.554179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.555055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.555336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.555606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.564901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.568557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:17.585179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:17.586162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:17.587071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:17.587489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.587489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.587489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.587489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/e2e8a60a8ef644e691a9a501ad2a4104/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.590004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 285/600] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:17.591146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.608147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=e2e8a60a8ef644e691a9a501ad2a4104, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.609839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.627666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 316/601] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:17 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/e2e8a60a8ef644e691a9a501ad2a4104/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:17.628969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.770749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ee93-7ce7-44a8-91a2-a25543dfeee8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.814853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352442-cea0-47ac-acec-6edf9c040573 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.826093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.827143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.827629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.828123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.829096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.829605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.831204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5ed00-5781-48f8-a726-23a00f5eaea9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.846034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 286/602] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.852323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc096a8-7b20-44d4-a53f-152beff72484 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.853190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc096a8-7b20-44d4-a53f-152beff72484 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.853624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc096a8-7b20-44d4-a53f-152beff72484 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.855609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 287/603] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:17.856531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc096a8-7b20-44d4-a53f-152beff72484 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.864098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.864921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.865207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.865488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.866288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.866601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.868034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740ae5-c3c0-4d8d-b61d-85f9e3c33473 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.881766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 317/604] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.883073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.883362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.883642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.900747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:17.901930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:17.970511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc096a8-7b20-44d4-a53f-152beff72484 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.977093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 318/605] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:17.977739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.006171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.007393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.007866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.008330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.015512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.017283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:18.032837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:18.033766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:18.034761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:18.037629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 288/606] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:18.038632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.117091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef94ec-2062-44f7-a967-840dde9d3a4e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.137236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda9c6a-bfed-4c19-9971-6aa2c2656071 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.160983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.162179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.162658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.163148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/5afe79ba075a4f4da308f8d982d00869/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.178621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=5afe79ba075a4f4da308f8d982d00869, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.179572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.180444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.180858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.181198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.181521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.195431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:18.203839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:18.204868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:18.205686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:18.207730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 319/608] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:17 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/5afe79ba075a4f4da308f8d982d00869/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:18.208898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.211296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 289/608] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:18.216703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.428184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c4124-869a-4f30-9f38-c9a986015484 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.429757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4b772-1588-4cb0-a0c6-cbf18ce106ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.465638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.466735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.467213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.467704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.468871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:18.469470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.469925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.470588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.470869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.471145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.471895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.472001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:18.473831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.475447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.482014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 290/609] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:18.487177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.493769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 320/610] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:18.499139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.625148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e731c-72e8-455d-b535-3bd4e0f10c1b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.661824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.662627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.662909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.663181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.674246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.676414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:18.694893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:18.695824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:18.696745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:18.696745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:18.696745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:18.696745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:18.696745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 291/611] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:18.700735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c164-ea93-4fa5-bbb6-72bfd406ec64 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.701916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.744454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.745413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.745691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.745963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/b14194021b484ce884af2c593d59e54e/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.761002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=b14194021b484ce884af2c593d59e54e, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.762495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.799160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 321/612] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:18 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/b14194021b484ce884af2c593d59e54e/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:01:18.818096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded9cc8-2d92-4864-ae6a-2698322ce2e1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.856793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.857513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.857796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.858068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.858793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:18.859095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.860514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.874272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 292/613] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:18.880287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.988993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2522-28fe-477e-b5bc-65ba8c570604 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.026313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.027126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.027407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.027677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.036750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.038205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:19.053912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:19.056216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:19.058440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 322/614] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:19.064674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:19.172311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a424b-bb35-4771-97b5-5b31d062d408 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.209441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.210194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.210374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.210648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.211486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:19.211793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.213258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.232134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 293/615] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:19.237597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:19.354421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142c16-f028-4034-b02d-bbba953b2e6a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.390725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.391528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.391811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.392087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.403699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.405155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:19.424627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:19.426837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:19.428953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:19.428953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:19.428953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:19.428953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:19.428953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 323/616] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:19.432241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:19.535786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970bd8-4f71-4539-b473-f18739776480 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.574335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.575010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.575286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.575559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.576290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:19.576596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.578135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.591363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 294/617] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:19.596721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:19.706329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c566d-c674-4ce5-916e-8326ddf33618 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.743084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.743886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.744171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.744444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.751387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.752851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-35662890-0524-43ea-83bf-121e549d8de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:19.767692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:19.770119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:19.772249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 324/618] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:19.780675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:19.880605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8a80-4f99-488a-9f1f-681d9e7cb958 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:19.887633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686944f3-47c0-48cc-953e-514a49a28bcd None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.887916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686944f3-47c0-48cc-953e-514a49a28bcd None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.888192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686944f3-47c0-48cc-953e-514a49a28bcd None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.889806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 325/619] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:19.903305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.903592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.903856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.920726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:19.921391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.921670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.921943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.922739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:19.923048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:19.924491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:19.937678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:19.938868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:19.944496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 295/620] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:19.954121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.053118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 326/621] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:20.089259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.118016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d110-9c80-469d-be80-db47e2613990 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.200844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.201754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.202028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.202296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/40e88dcd650d4783979ca3fd848203bd/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.221085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=40e88dcd650d4783979ca3fd848203bd, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.221959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e16f-22ac-42e0-b7ea-174482d0e977 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.222727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.236265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 296/622] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:19 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/40e88dcd650d4783979ca3fd848203bd/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:01:20.278797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.279634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.279912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.280182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.297994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:20.306567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.307526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:20.308381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 327/623] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:20.314009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.493106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562c-989f-409c-a87a-460964feb6fb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.539446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.540685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.541176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.541679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.542707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:20.543250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.544988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe81005-c1ab-40c7-aaa7-a0d5c91e1b5d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.554676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 297/624] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:20.560066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.670731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076ff6-4624-431b-9b63-63d046438016 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.671367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076ff6-4624-431b-9b63-63d046438016 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.671867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076ff6-4624-431b-9b63-63d046438016 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.673690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 298/625] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:20.680723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.681318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.681802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.693966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736eea-f784-4f7b-82af-5d413b2e11e1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.704046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:20.705759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:20.743966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.745039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.745628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.746870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.760194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.762446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.782454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 299/626] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:20.788689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.789591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.790489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:20.790489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:20.790489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:20.790489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:20.792422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 328/627] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:20.798066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.815467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.914019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4a1a2-0492-4bca-94bc-de1ad5df5ed0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.919946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abc9f6-8ad2-4e9f-acea-8eec656cffa6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.951355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.952422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.952893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.953318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.957891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.958549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.958830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.959124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.959817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:20.960118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.961664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a6050-990d-4301-bb6b-c587db0a59cc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.965280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:20.973158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.974274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:20.975230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:20.975904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 300/628] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:20.975904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c610-1f54-4985-b519-228e8ba47716 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.975904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c610-1f54-4985-b519-228e8ba47716 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.975904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c610-1f54-4985-b519-228e8ba47716 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.977679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 329/630] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:20.980016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.980133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 301/630] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:20.982087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.982374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.982659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.000090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:21.001223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:21.072820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 302/631] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:21.073845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.099041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bd701-7bbd-41c0-85f0-dcc6d973b100 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.133919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.134713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.134988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.135262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.143500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.145917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:21.160719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.161846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 330/632] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:21.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.200906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c31cc9-e90d-4345-b8cf-1f66245519db None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.235110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.235800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.236038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.236292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.237090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.237357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.239640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.248214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 303/633] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.249111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.270659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcbea-a654-4614-97bb-d6b1db663206 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.306578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.307770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.308266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.308819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.320458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:21.328713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.329668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:21.330629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:21.338856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 331/634] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:21.340070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.362327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3f12-7977-4086-9cdf-840f7d4e20b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.398486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.399264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.399607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.400022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.400938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.401344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.403162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.421295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 304/635] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.422644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.447867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee467-539c-4de9-9ef0-a95b1cd850e8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.483441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.484513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.484983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.485402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.497252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.498937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:21.516349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.517302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.518185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:21.518185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:21.518185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.518185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:21.520886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 332/636] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:21.521923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.526067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0635-f0de-420e-9d53-af5957a4fea1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.562443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.563201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.563544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.563890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.565059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.565059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.566538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.579213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 305/637] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.580123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.625667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ec27-bea8-431d-bc9a-cc8b8d811347 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.663179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.664213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.664713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.665164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.689553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee08b6-4573-4442-bf33-194d3512780b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.723621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.724265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.724545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.724869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.725710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.725890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.727240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.744768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 306/638] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.744768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.751201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.752893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.854845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52f7b-044c-4e4b-a46f-618f59bbc779 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.872076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 333/639] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:21.872076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.893063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.894377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.894675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.894949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.905226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.906662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-272c53ab-67bd-4ea1-a731-a0cf4a079641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:21.924430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.925510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.926466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:21.926466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:21.926466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.926466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:21.926466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 307/640] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:21.927232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcba06-0280-46bd-9edb-2900a81b9383 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.927518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcba06-0280-46bd-9edb-2900a81b9383 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.927791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcba06-0280-46bd-9edb-2900a81b9383 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.930886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 308/641] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:21.930886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcba06-0280-46bd-9edb-2900a81b9383 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.978175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7cce-631a-4abf-9d87-f24d9950508b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.011049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.011834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.012110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.012376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.020513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.022022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.031388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcba06-0280-46bd-9edb-2900a81b9383 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:22.036285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:22.037483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 334/642] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:22.043193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.074009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.075045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.075388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.075722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.086142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.087574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5bee4ca8-43c8-4d97-b0f6-1393e6d444f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:22.105765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:22.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:22.107995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:22.107995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:22.107995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:22.107995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:22.113388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 309/643] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:22.113388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.113388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.113388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.125819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:22.126979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:22.153052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de896-c7e5-4444-b191-a1784feb151c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.189059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.189713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.189989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.190264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.191498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.191792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.192412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 310/644] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:22.193268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.201593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.213425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 335/645] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.214238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.301023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6576e7-15d3-4460-ace3-634e17fe3e44 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.310909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3b16-08af-4554-a576-860ae19559de None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.334985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.335654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.335931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.336207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.337062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.337369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.338795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.343632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.344289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.344566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.344862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.345570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.345871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.347247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.360679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 311/646] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.360679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.364318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 336/647] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.368869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.453369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fde99e-eb67-4c29-8b38-6973e26640a1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.468187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0941e1-6ac2-4732-87ae-1b1f5f534998 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.486627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.487424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.488219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.488493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.498591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:22.504189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.505182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.505462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.505729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:22.507004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:22.507923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:22.508790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 312/648] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:22.510053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.515984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.517643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:22.537465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:22.538415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:22.539345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:22.540738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 337/649] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:22.541602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.615695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b06-8879-4921-a0d7-6504adeace73 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.638058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7588-7088-4cce-8ea3-bbf038f48a70 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.647800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.648443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.648753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.649022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.671861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.672666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.672963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.673234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.680352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.681832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:22.695996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:22.697115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 338/650] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:22.698036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.720487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.722050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.798173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4a79-12f2-43cb-9716-b68bdfa7a33e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.825537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 313/651] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:22.826387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.836582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.837275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.837551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.837820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.838556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.838857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.840194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.849122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 339/652] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.849933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.935567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962c96-8101-42b3-830d-6fa0bad2ae95 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.947328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c406-25db-437c-b6fc-87292433b600 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.969387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.970055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.970335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.970635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.971468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.971771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.973289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.979705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.980354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.980631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.980932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.981763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.982049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.983441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.990152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 314/653] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.990837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.995411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 340/654] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:22.996211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.083850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e5215-e279-46ca-9863-17013503e73e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.091356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c34c-e14b-447c-8ad9-9b4c92362882 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.115037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.115839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.116120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.116386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.123130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.123911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.124190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.124461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.125729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.127137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.134647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.136052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-dbf2e5cb-f607-43ef-a140-f24d570c3d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:23.144249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.145389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.146570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:23.146570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:23.146570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.146570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:23.146570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 315/655] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.146912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d5ba-150c-44a6-91b6-4fc37f4a7cd6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.146912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d5ba-150c-44a6-91b6-4fc37f4a7cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.147134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d5ba-150c-44a6-91b6-4fc37f4a7cd6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.148501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 316/656] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:23.149081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9d5ba-150c-44a6-91b6-4fc37f4a7cd6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:23.156963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.158021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.158935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:23.158935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:23.158935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.158935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:23.158935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 341/657] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.159487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.244836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9d5ba-150c-44a6-91b6-4fc37f4a7cd6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.254540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bd19-64ca-418a-82a0-01b8a651a605 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.276716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.277501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.278031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.278301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.286374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.287014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.287294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.287568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.288397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:23.288804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.290239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904f4f-c9ec-4b89-9905-5c9884c87ca2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.295799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 342/658] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:23.296991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.297274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.297547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.326860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:23.328094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:23.352626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.354132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.402320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 343/659] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:23.403528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.493335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 317/660] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:23.493335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.514991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56953-2a76-45f1-a2b5-1020a154661e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.555214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.555881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.556161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.556429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.557189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:23.557487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.558837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.570578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 344/661] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:23.571537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.596714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f4a1-34ce-499f-9e98-a1ff96ebe936 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.630456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.631112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.631387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.631658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.632369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:23.632693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.634077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.645335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 318/662] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:23.646411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.673741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad866-a921-46a8-9179-1c12b9710cc7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.706685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.707564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.707842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.708108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.718010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:23.726275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.727219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:23.728077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 345/663] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.728804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.752685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05f05-3e12-467b-96ff-734dcb786465 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.786477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.787189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.787464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.787734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.798011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.799472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:23.817845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.818787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.819688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:23.819688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:23.819688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:23.819688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:23.819688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 319/664] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.820406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.836706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575c99-9caf-42d1-b56b-092d452cdfa9 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.871544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.872332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.872612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.872929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.879594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.881056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:23.895623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.896598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:23.897523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 346/665] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.898012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.917890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4f813-522a-4596-a46b-d419350eb6c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.950453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.951253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.951538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.951808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.959832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:23.961296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:23.977275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.978259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 320/666] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.979208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.006720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5290bb5-25b3-403b-8f72-d288f154bc30 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.042613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.043805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.044693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.045100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.048464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.048464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.048725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.059447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 347/667] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.059447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.083992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edcd26-d5e9-491a-a0fa-6749fcdfcaf2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.117782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.118444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.118720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.118990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.119702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.120003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.121368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.136995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 321/668] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.136995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.161734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79a8c2-01e5-4591-9f44-7be672c3b75a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.193284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.193946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.194227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.194497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.195284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.195590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.197048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.214076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 348/669] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.214076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.234527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9367-8df8-49d0-a2fd-70ff183a369b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.267023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.267767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.268117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.268459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.269481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.269794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.271216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.289214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 322/670] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.290037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.313009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07f4f-dae6-4653-b9f4-7c29ea54cb72 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.347256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.348248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.348623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.349012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.358679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.360222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:24.377343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:24.379091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:24.380189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:24.380189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:24.380189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:24.380189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:24.380599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 349/671] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:24.381380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.393445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db06a3c-269e-4944-8378-983eb6be58ed None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.427758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.428730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.429119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.429392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.435966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.437412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:24.451798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:24.452899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 323/672] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:24.459266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.492779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb98f5-4927-49e9-b347-bc6dcfbd3e7b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.525511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.526166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.526443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.526718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.527539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=e2e8a60a8ef644e691a9a501ad2a4104) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.528115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.529562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.536351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 350/673] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/role_assignments?user.id=e2e8a60a8ef644e691a9a501ad2a4104&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.537250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.574370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10589-42a3-4f5e-b503-77a12095ce6e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.623136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.623982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.624268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.624544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.678870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700366-bebe-4861-b02c-d4d54aafa501 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.716870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.719001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.730004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.730890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.731269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.732314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.733085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.733400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.735508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.752744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 351/674] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.754686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.852449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 324/675] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:24.853761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.880698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb1cd-b0f8-424f-a4da-550928b11fa5 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.906141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.906805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.907087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.907364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.908148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.908456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.911165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.923303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 352/676] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.924144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.968915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198695b-3937-4144-b06e-45bb45fd13f3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.002837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.004268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.004553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.004854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.012276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.013753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:25.028516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.029561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:25.030521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 325/677] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:25.031715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.031878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbaa-b522-452a-b327-37f1a57a0315 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.085847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.086926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.087368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.087807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.099505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:25.121098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.123387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:25.123387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:25.123387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.123387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:25.125253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 353/678] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:25.126178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.134670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9e48-764b-40e9-8283-27db334a04e6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.169235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.170187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.170187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.170424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.171258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=5afe79ba075a4f4da308f8d982d00869) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.171574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.173031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.184950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 326/679] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/role_assignments?user.id=5afe79ba075a4f4da308f8d982d00869&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.185929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.245850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085b430-7daf-4092-bfe8-ecf0e6b8fb77 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.282918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.283868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.284315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.285971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.287018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.287491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.289164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.292672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6fed5-1daf-4d26-b703-ff159ce82a38 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.313092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 354/680] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.314918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.327843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.328667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.328837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.329112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.329907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.330139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.331777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.344593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 327/681] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.350814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.426770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afd92-2ee1-4573-a0d8-23efadf2df70 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.457221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07c8b-d5bd-4424-a07f-211000994c1b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.463892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.464776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.465234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.465656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.492627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.493453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.493731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.494000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.501221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.502720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:25.518288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.520692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:25.521840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 328/682] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:25.526118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.546238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.547989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.636103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28e872-5216-4ef5-852c-5d6e5dd60d76 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.662423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 355/683] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:01:25.668082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.669758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.670425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.670702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.670975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.672308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.672308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.673528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.686550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 329/684] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.693033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.773471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e0e6-bfc1-4ec4-9ca8-a9aa815d7b52 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.792858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a4c-63ef-4632-93e1-4ccbaf08e505 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.813997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.813997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.814287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.814899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.832516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.833998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.843167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.844117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.845051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.845547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.846909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=b14194021b484ce884af2c593d59e54e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.847513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.849180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-11ce9f5b-ced7-4f12-ad31-3aab08c124ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:25.854060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.854949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.855834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:25.855834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:25.855834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.855834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:25.855834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 356/685] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:25.857074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cad1f-5bc7-46d7-80fb-4a267e109ff1 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.857355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cad1f-5bc7-46d7-80fb-4a267e109ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.857629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cad1f-5bc7-46d7-80fb-4a267e109ff1 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.858972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 330/686] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/role_assignments?user.id=b14194021b484ce884af2c593d59e54e&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:25.861232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.863344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 357/687] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:25.867103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.867384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.867722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.893608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:25.895301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:26.008067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb434446-d159-47d4-81c1-cd149335b367 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.047923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.047923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.047923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.047923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.048349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.048349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.049033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.067367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 331/688] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:26.072701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.087834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 358/689] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:26.114071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.181750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db8ac-e59d-42a2-bd66-dcf035004fe7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.215983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.216826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.217091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.217359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.222520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca6a9-04f4-4197-b338-24fb18266da6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.224894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.226328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:26.240083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:26.241082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:26.241966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:26.246089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 332/690] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:26.247264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.262650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.263788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.264286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.264786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.277062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:26.285765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:26.286674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:26.287534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:26.290326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 359/691] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:26.296044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.350995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9efe8d-b43c-490b-8c9f-ce7e251f2efc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.406513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.407535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.408038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.408509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.409592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.410135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.411766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.425489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab81-b11c-446b-a5db-59f8ebebde41 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.442837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 333/692] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:26.448847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.492433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.493533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.494016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.494542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.495514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.496019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.497599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.513674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 360/693] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:26.519514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.564786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2eaf2-10ef-410d-93f8-7a1df60398b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.598840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.599496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.599775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.600047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.600972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=40e88dcd650d4783979ca3fd848203bd) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.601225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.602652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.616498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 334/694] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/role_assignments?user.id=40e88dcd650d4783979ca3fd848203bd&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:26.651061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e64b-0fc7-43a7-9216-51f5a748ead3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.696421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.697663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.698178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.698647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.715645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.725080 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:26.738332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:26.739294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:26.740182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:26.740182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:26.740182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:26.740182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:26.740182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 361/695] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:26.745925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.917832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c232-2b02-4b38-8b80-c92dc4695dbd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.952791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.953454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.953732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.954001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.954721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.955019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.956484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.968712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 335/696] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:26.973747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.095611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8112-38eb-42f5-b2be-f16077ca6996 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.132404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.133233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.133514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.133788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.141925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.143524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-f7c624d5-7d66-4f0c-ac22-035c638e612b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:27.158659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:27.160247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:27.161342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:27.164674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 362/697] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:27.166309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.267525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f8f9-7c31-4a39-b584-657fdae50eaa None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.268184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f8f9-7c31-4a39-b584-657fdae50eaa None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.268757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f8f9-7c31-4a39-b584-657fdae50eaa None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.270138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd8904-6d28-4e77-9079-ea3366169f8a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.270791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 363/698] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:27.276256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.276885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.277361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.296956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:27.298524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:27.330191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.330838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.331142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.332050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.332921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:27.333223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.334752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.371640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 364/699] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:27.375217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 336/700] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:27.380548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.434633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.483776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1755f8-c02a-4c9f-9fae-609678bca0b9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.519071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.520158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.520675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.521178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.592579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.594423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.664264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629571e7-abfe-4c8b-8a63-acb47d8a148d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.697276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 365/701] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:27.703021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.748035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.748917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.749191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.749549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.770131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.771491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:27.799285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:27.800829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:27.801864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:27.801864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:27.801864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.801864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:27.804036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 337/702] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:27.808837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfba68-1732-4553-9f21-aee6ead53d0b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.813626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.844897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.846048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.846539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.847077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.858311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.860433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:27.881160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:27.882104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:27.882998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:27.882998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:27.882998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.882998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:27.886537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 366/703] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:27.892041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.009179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a9ce0-c4a1-48ae-91e8-d63031069498 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.048107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.049188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.049687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.050469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.051426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.051941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.053722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.068109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 367/704] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:28.074264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.078796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822376-0fc2-4262-b242-8b3d6320f61e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.163486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.164160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.164445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.164747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.165472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.165779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.167140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a6d1-194c-4ccd-bc89-6abb41b882bd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.180013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 338/705] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:28.181338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b90b7-5b23-4a94-8c76-825281972036 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.181627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b90b7-5b23-4a94-8c76-825281972036 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.181903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b90b7-5b23-4a94-8c76-825281972036 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.183386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 339/706] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:28.183570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0f7c0-381b-43d5-9610-4c331203f844 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.185069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b90b7-5b23-4a94-8c76-825281972036 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.221593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.223738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.223738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.223738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.230682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.232176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-8a9daec6-a4b6-4a34-8885-ff6811a928ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:28.246702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:28.247646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:28.248576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 368/707] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:28.249505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.249746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.250020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.267354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:28.268601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:28.296601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b90b7-5b23-4a94-8c76-825281972036 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.332602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.333597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.334062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.334513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.335416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.337065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.340722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 369/708] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:28.341760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.373870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 340/709] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:01:28 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:28.375005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.527609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be167e-2300-4614-b044-7b2d4963d4a5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.574283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.574820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf749d-da6e-4c9d-99f7-d0b0522e2ca2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.575801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.576485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.577003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.577886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.579620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:28.598467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:28.599556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:28.600436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:28.603719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 341/710] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:28.610069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.637365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.638331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.638815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.639259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.640230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.640748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.642393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.657919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 370/711] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:28.670120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.744088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa97a-9cf7-4c2e-bbbc-d1bbb6ea237d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.794661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.795274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.795558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.795842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.796550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.797006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.798351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.803082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 342/712] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:28.804709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e499-57ba-4f06-8173-388ec84be80c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.810271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:28.845552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.846451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.847224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.847647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.851431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.851710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.853207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e278-915e-451b-bfcd-1f8bd1915959 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.859225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 371/713] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:28.861482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72a4d-030c-4da0-83f5-b42a653dc0b8 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.861775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72a4d-030c-4da0-83f5-b42a653dc0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.862058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72a4d-030c-4da0-83f5-b42a653dc0b8 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.863994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 372/714] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:28.869774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.870082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.870351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.888185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:28.889403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:28.927999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7cd6-3785-46f1-9b0e-a757cb0a544f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.960811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 373/715] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:28.967462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.968526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.969061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.969556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.970502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.971020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.972813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.984830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 343/716] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:28.995004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.271601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c792a4c-3c54-4fa2-8c60-65dd285507eb None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.305906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.306710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.306989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.307264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.307926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.309313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:29.323025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:29.324071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:29.325563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 374/717] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:28 2022] GET /identity/v3/services/network => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:29.333933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.451242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda15e7-b6ef-4d54-b808-4ffe2e0b8f0f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.492044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.492990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.493414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.493853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.494707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] RBAC: Adding query filter params (name=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:29.495212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.496858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e243d-8276-4586-9d00-9bcdf3b9f056 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.501597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 344/718] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:29.507827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.642679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d310-3436-4434-b87b-2b21ea03ea31 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.686248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.686923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.687238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.687508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.688211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:29.688510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.689876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e53a-7a7c-44ee-b234-083a4b9bb7c3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.696316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 375/719] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:29.818120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243113-7c04-4a36-a42b-145a18e4d6a1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.819129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243113-7c04-4a36-a42b-145a18e4d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.819612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243113-7c04-4a36-a42b-145a18e4d6a1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.821606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 345/720] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:29.827278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.827581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.827842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.845403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:29.846588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:29.931511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 376/721] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:29.964674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48243113-7c04-4a36-a42b-145a18e4d6a1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.122285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48243113-7c04-4a36-a42b-145a18e4d6a1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.171363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.172164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.172446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.172745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.186502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:30.194278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:30.195212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:30.196528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 346/722] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:30.205763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.319500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157e88-3fc5-499b-9bcd-4c93eff90438 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.352943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.353625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.353901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.354171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.354923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.355225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.356608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.366816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 377/723] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:30.372255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.554467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ee32-340f-4629-b130-1a0d684b9ecd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.602925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.603724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.604003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.604275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.625796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.627247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:30.650530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:30.651487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:30.652919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:30.652919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:30.652919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:30.652919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:30.652919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 347/724] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:30.657774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.781406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a979-3c9b-47ba-897f-53856d2ce83d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.815567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.816298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.816581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.816879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.817602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.817901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.819255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.831563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 378/725] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:30.836705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.004916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee332ba0-c293-4112-ae14-bd9a23362ab9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.053357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.054164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.054448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.054720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.066392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.067788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:31.087061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:31.088047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:31.089050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:31.092779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 348/726] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:31.093770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.254257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b0ce-5713-489d-bf4d-4356143574b2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.297664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.298339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.298621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.298898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.300277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:31.300595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.302054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1edf4-7d60-4dfe-a0a6-6fd9b02caca2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.328271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 379/727] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:31.333344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.389647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084bfb-bac6-4c72-b314-69cf09d2cb61 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.389934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084bfb-bac6-4c72-b314-69cf09d2cb61 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.390213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084bfb-bac6-4c72-b314-69cf09d2cb61 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.391621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 380/728] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:31.399526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a65-ff65-417c-839e-8171266e1718 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.399830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a65-ff65-417c-839e-8171266e1718 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.400085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a65-ff65-417c-839e-8171266e1718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.434171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d3957a65-ff65-417c-839e-8171266e1718 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:31.435360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d3957a65-ff65-417c-839e-8171266e1718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:31.499046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498b2-44bd-421c-bfe7-f658ce1e3d23 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.551535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.552240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.552525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.552824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.569348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 381/729] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:01:31.588267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06eb5-eae8-4bc9-8f56-f0dfb08d442c None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.588267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06eb5-eae8-4bc9-8f56-f0dfb08d442c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.588267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a06eb5-eae8-4bc9-8f56-f0dfb08d442c None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.588267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 382/730] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:31.595786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a06eb5-eae8-4bc9-8f56-f0dfb08d442c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.641953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.643793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9230c17-4af0-41ae-abde-bbe96a541d5f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.697288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a06eb5-eae8-4bc9-8f56-f0dfb08d442c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.733131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.733926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.734203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.734475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.745170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:31.750249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 349/731] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:01:31.751877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.752394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:31.752875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:31.753798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 383/732] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:31.759648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.760395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.775832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:31.777054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:31.852749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 350/733] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:31.852749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.891124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175863b-40ac-43c3-b2a2-2f884f032dd0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.926253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.927036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.927316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.927584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.937705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.939122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:31.956530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:31.957864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:31.959305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:31.959305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:31.959305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:31.959305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:31.959537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c8cae-e558-4794-806b-ee20aabc9997 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.959615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 384/734] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:31.959615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.993852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.994820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.995305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.995755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.996696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:31.997337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.998883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387aa9e-3702-40f9-8bae-6b52f2cf6525 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.008048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 351/735] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.009625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737bc3-bbf3-4f33-93c3-13ef076af865 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.010112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737bc3-bbf3-4f33-93c3-13ef076af865 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.010384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737bc3-bbf3-4f33-93c3-13ef076af865 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 352/736] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:32.015612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737bc3-bbf3-4f33-93c3-13ef076af865 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.067387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f06a1-7293-478c-ab22-733f70792428 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.100346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.101177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.101462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.101735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.111969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:32.113109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737bc3-bbf3-4f33-93c3-13ef076af865 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:32.120174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:32.121194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:32.122063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 385/737] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:32.122749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.153092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.153765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.154202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.154481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.155781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:32.156094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.157647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e37aa-6985-49e9-9d64-5850526c7fdb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.177614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 353/738] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.177614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.177614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.177614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.193104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:32.194259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:32.223294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbe74e-a595-435c-9282-13f6126dac6e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.255604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.256396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.256694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.256971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.264867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 354/739] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:32.265971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.280051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.282638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:32.303370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:32.304338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:32.305278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:32.305278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:32.305278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:32.305278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:32.309167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 386/740] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:32.309888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.365949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e4ca0-7634-4a7c-accc-f25ca3c4c7e3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.405388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.406085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.406367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.406641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.407213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc79de-acf9-4f65-8655-13e7426c48ea None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.407671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:32.407749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.409975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.421500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 355/741] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.422358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.445710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.446499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.446778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.447051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.453747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.455161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:32.469794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:32.470719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:32.472267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 387/742] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:32.472794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.527511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2e5a-1ae2-42ee-b808-cc75204a8345 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.562771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.563438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.563721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.563999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.564746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.566331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.580242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 356/743] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:32 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:32.581743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.591575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48947-f03b-4e58-af9c-f20efad6ffa3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.636383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.636994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.637274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.637546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.638283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:32.638591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.640534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.657615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 388/744] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.657615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.696890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c18594-5285-4391-8410-d715a0f99063 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.732156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.733019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.733291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.733566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.745516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.747001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.758781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f564c1-c303-4fb7-9cfb-a498163c5245 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1f9b12b0-2f3f-4748-84fc-3b7d5da8c4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:32.765331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:32.766220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:32.767401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:32.767401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:32.767401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:32.767401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:32.767401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 357/745] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:32.767846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060d51-d75b-45fe-89d1-331c9b92a794 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.768106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060d51-d75b-45fe-89d1-331c9b92a794 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.768461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060d51-d75b-45fe-89d1-331c9b92a794 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.770315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 358/746] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:32.771009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060d51-d75b-45fe-89d1-331c9b92a794 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.803426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.804091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.804583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.804933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.806086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:32.806425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.807830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.820452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 389/747] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.821399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:32.877848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060d51-d75b-45fe-89d1-331c9b92a794 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.911251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.912290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.912683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.912933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.920198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.920346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57859-4585-4b35-92ae-6a1ba4e9c70e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:32.921673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-90e1fb6b-cee7-438c-bf97-79e481cdb92a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:32.936729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:32.937889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:32.938854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 359/748] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:32.939467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.939467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.939674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.956504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:32.957706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:32.966797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:32.967460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:32.967740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:32.968010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:32.968753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:32.969060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:32.970414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:32.981978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 390/749] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:32.982774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.029353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 360/750] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:01:33.030202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.095638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ff8a-2982-4f19-883c-4737657c1156 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.131329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.132001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.132279 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.132546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.133435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=40e88dcd650d4783979ca3fd848203bd) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:33.133807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.135285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.141621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 391/751] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:32 2022] GET /identity/v3/role_assignments?user.id=40e88dcd650d4783979ca3fd848203bd&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:33.148815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.260305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef787e-9342-4428-853f-8422b09e2f00 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.262320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608c5dd-33b8-4066-8ace-e51743559679 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.296598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.297431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.297717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.297990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.298563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.299242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.299527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.299835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.300814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:33.301123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.302601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.307077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.308534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.323004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 361/752] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:33.323917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:33.329048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:33.330040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:33.331083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 392/753] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:33.332351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.427269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24583-190c-41d7-8c1a-ba91405d62b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.454286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2da2a-9aa5-4912-affa-d523a6698c50 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.460826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.461495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.461775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.462050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.462776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.464134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.482375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 362/754] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:33 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:33.483215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.539263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.539837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.540118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.540392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.603454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4820-1edc-4798-8022-61e1582f4bcf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.644925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.645616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.646086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.646370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.647237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:33.647547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.649654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.673577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.674375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 363/755] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:33.675290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.681208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.799208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 393/756] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:33.803837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.807954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93cbc7-6415-4527-9388-31a4a19b8d9f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.846760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.847604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.847882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.848147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.859381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:33.860875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:33.880057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:33.881462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:33.882356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:33.882356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:33.882356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:33.882356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:33.882356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 364/757] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:33.887200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:33.936735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6706-7244-4d21-b8c3-6b8c5d2a4ad0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:33.990701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:33.991506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.991790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.992062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.002497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db89a3-f411-403e-8650-612253d9dd06 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.014674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.016125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.051427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.052418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.052908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.053380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.054294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:34.054776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.056384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:34.060911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:34.061842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:34.063261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:34.063261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:34.063261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:34.063261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:34.067199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 394/758] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:34.079762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 365/759] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:34.085647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.085805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.196358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf029-2f30-4772-855e-c6b5a197bd1a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.232737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.233770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.234227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.234657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.241620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.243228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:34.257602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:34.258703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:34.259810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:34.261917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 366/760] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:34.267449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.303727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4783436-8524-406f-a6b4-a7ce56733b12 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.366087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.366756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.367037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.367311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.368125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:34.368429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.369821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.381832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 395/761] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:34.388349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57bc49-6d50-45a2-b724-0de557d9b3e8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.397498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.452821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.453732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.455143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.455596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.457744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:34.458225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.459796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.488745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 367/762] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:34.496562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.570786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe7b13-d357-4d9c-a0fe-ccc8eb4ed7c4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.633449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.634248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.634524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.634797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.646926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.648370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:34.672086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:34.673090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:34.673984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:34.675478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 396/763] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:34.683132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b6d95-cf07-4f08-9d88-3bea1afcfb3b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.685996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.749346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.750244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.750522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.750841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.753660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=a3fa3765319b4024ab300ae52161d649, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.755228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.800183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 368/764] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:34 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:01:34.811383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d88473-b843-4a57-a477-f71f93644d80 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.852209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.852871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.853152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.853423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.854237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:34.854546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.856065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025888e-3bad-412a-a3ec-9292acbc3a26 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.870028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 397/765] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:34.876050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.030038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35876-e7b5-4705-812e-47aa0505e3e8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:35.075688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bc4ad-7fb6-437e-89f1-40d76b563fa2 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.075964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bc4ad-7fb6-437e-89f1-40d76b563fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.076240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bc4ad-7fb6-437e-89f1-40d76b563fa2 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.077848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 398/766] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:35.082877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:35.083579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.083861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.084136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.085000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:35.085312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:35.085979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.086266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.086537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.086762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:35.093697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 369/767] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:34 2022] GET /identity/v3/role_assignments?user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:35.111468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:35.113213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:35.195209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 399/768] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:35.236172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.368812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb2d0-e804-4480-b42d-33d28dba2318 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:35.422663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:35.423478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.423755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.424023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.424727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:35.426085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:35.438831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:35.439847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:35.440738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 370/769] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 10 03:01:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:35.448411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.576173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9074-517e-4e0c-a731-67d4e837854d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:35.626908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:35.627551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.627965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.628320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.629059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:35.629369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:35.630717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79285de-12e9-418a-a5af-52f4ba58f912 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:35.638044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 400/770] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:35.644856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.672040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7534-92d2-48dd-ac80-899e4cf76bca None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.672346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7534-92d2-48dd-ac80-899e4cf76bca None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.672583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7534-92d2-48dd-ac80-899e4cf76bca None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.673961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 401/771] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:35.690478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.690898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.691180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.722299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:35.723682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:35.775666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500352-aa92-4d21-a1d6-08e93940fa23 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:35.818028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:35.818698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.818975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.819242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:35.819950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:35.820250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:35.821648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:35.827002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 371/772] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:35.834900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.835174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 402/773] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:35.859223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:35.955095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1818eb-f973-4edd-bcae-debc47c12711 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:35.998385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:35.999056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:35.999336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:35.999616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.000406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] RBAC: Adding query filter params (interface=public, service_id=5fa45de172134f90a3a1a1dd1f1a6ccc, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:36.000739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.002109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.021218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 372/774] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:01:35 2022] GET /identity/v3/endpoints?service_id=5fa45de172134f90a3a1a1dd1f1a6ccc&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:36.027114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.069076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720280-127f-4dab-8b92-225c69c1a23d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.118678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.119478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.119757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.120026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.144402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:36.161671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:36.162653 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:36.163497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:36.164607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 403/775] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:36.168958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.186344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1425d44-b6ed-4f5f-aa69-aa7fe78b709e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.225157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.226182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.226684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.227154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.228063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.229783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.246284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 373/776] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:36.297636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0efc-d68d-4e16-868c-5bb331f91e0c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.340348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.341054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.341338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.341610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.342366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:36.342671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.344059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab72a-3f0a-4766-a835-3efc87db22af None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.358406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 404/777] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:36.359909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.433161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba95b3-0502-4640-9a75-217ad46dd18b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.433516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba95b3-0502-4640-9a75-217ad46dd18b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.433732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba95b3-0502-4640-9a75-217ad46dd18b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.435328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 405/778] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:36.441634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.441921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.442197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.488313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ac4e-2597-478d-9b94-48cf886f703e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.489756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:36.491163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:36.529982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.530842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.531127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.531395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.545619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.547137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:36.568598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:36.569630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:36.570518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:36.570518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:36.570518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:36.570518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:36.570518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 374/779] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:36.575828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.598778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 406/780] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:36.621876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.679766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78229c5-fbe5-46cb-b36b-f86b0a6b14dd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.713939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.714945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.715433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.715922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.716915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:36.717426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.718996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.723412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681ce6-8264-4aa6-a23a-c56565dfb86e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.732942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 375/781] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:36.738811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.791728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.793026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.793548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.794028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] PATH_INFO: `/v3/services/network` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.794910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.796541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:36.810789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:36.811848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:36.812709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:36.815901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 407/782] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:36.821877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.884217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64756b-5c49-40dd-b563-e39ba50ea85f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.929373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.930240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.930460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.930731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.942510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdd176-c234-4a59-b6b1-897251964123 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.944443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.951898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.979610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:36.980535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:36.981517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:36.982491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 376/783] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:36.983850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.984350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.984911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.985826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:36.986561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.989045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.989535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.994740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 408/784] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.005587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.151395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fcd4d-f7e2-4cd7-8b38-9619cdc58a65 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.157514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87853dd-f0de-45ac-94a2-cb2dd84c64f4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.194498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.195804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.196743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.197608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.198090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.198567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.199055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.199527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.200580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:37.201501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] RBAC: Adding query filter params (type=network) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:37.202008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.202507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.204058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.205748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.214134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 409/785] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.233559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 377/786] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.234991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.239469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.387551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122aa82-0666-4077-a996-a7aff9da7c00 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.431973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa269e-a84d-4c92-a8b4-2eefe256f540 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.457751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.458476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.458760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.459031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.459837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] RBAC: Adding query filter params (interface=public, service_id=75dba5ae9a0547818e7af3a751062410, region_id=RegionOne) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:37.460148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.461537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.475989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 410/787] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/endpoints?service_id=75dba5ae9a0547818e7af3a751062410&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.481359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.501159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.501886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.502164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.502436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.514682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.516149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:37.537374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:37.538325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:37.539226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:37.539226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:37.539226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:37.539226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:37.543243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 378/788] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:37.545201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.620040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6265-2141-4870-a8a2-513911b73c7e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.654143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.654805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.655132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.655412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.656087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.657476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aac50-f249-4553-adab-4951049766bd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.662857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 411/789] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.664091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac111-535b-4934-b529-1525842deb67 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.664375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac111-535b-4934-b529-1525842deb67 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.664667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac111-535b-4934-b529-1525842deb67 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.666237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 412/790] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:37.667420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6023-48cd-417d-a759-1d5e860d0735 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.672104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.672422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.672682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.696546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:37.698499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:37.769500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.770103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.770381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.770652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.771397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:37.771890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.773333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.777233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 413/791] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:37.801262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 379/792] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:37.807302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.816723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.929168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33fae-da99-4bc2-a907-64a83a782a28 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.970032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.971409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.972039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.972821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.981670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.983716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4182a810-0bf0-4a78-84de-f0027f896e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:38.003007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:38.003955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:38.004871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:38.009500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 414/793] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:38.010853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590d6c-3bb5-46e0-80f9-48be2961cabd None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.011139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590d6c-3bb5-46e0-80f9-48be2961cabd None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.011416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590d6c-3bb5-46e0-80f9-48be2961cabd None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.012727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 415/794] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:38.013418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590d6c-3bb5-46e0-80f9-48be2961cabd None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.025904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b8b2c-b28d-4aa9-ad99-eb47af3525f7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.067840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.068870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.069323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.069751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.080098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b642be05-cd21-4f94-a405-6b60eb1541cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:38.088486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:38.089488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:38.090328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 380/795] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:38.091507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.096469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.096908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.121700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:38.122892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:38.134938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590d6c-3bb5-46e0-80f9-48be2961cabd None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.169371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.170503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.171042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.171331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.172262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:38.172566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.174137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.190791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 416/796] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:38.191716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.197671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 381/797] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:38.198510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.298586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e20134-e957-44a9-8879-368ebe12f7d7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.318400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f1c30-8b43-4f73-bd44-18767aa2fdbc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.333428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.334107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.334388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.334660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.335407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:38.335715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.337128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.350637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 417/798] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:38.351527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.357897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.358791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.359066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.359391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/40e88dcd650d4783979ca3fd848203bd/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.362561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=40e88dcd650d4783979ca3fd848203bd, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.364974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.384285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 382/799] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:38 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/40e88dcd650d4783979ca3fd848203bd/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:38.385316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.491291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ecf68-62cd-4bb6-b313-32a6800c32cc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.514558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc4fc-60ba-4e20-a856-acaf7a38bb4d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.541095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.541921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.542234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.542451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.553092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.553842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.554124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.554465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.563570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.565714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.567802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:38.575984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:38.578243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:38.579285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 418/800] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:38.583384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:38.602197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:38.604336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:38.606484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:38.606484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:38.606484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:38.606484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:38.608686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 383/801] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:38.622956 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.722487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e88d6-e166-4fd3-8e55-9859e7c0022a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.756481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930bc4-fc60-436e-a3c4-1c7d68891559 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.759259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.759938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.760223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.760498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.761964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:38.761964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.762993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.772688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 419/802] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:38.779635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.798492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.799166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.799476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.799751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.800475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:38.800810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.802180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.828163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 384/803] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:38.833695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:38.889424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c99d4-0c1b-4b45-84ab-55ed35142d26 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:38.924129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:38.926721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:38.927213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:38.927693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:38.938908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:38.941667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:38.959357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:38.960264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:38.961547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:38.961547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:38.961547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:38.961547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:38.963517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 420/804] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:38.970908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.077607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86bd3d-d906-4ba3-a7ca-93e4cf82878c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.101524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b2304-f9a9-4f04-856f-e79b610cca95 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.111175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.112320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.112627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.112924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.120500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.121960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3b036ec9-dfe2-4738-aefb-f2b53faadf80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:39.136519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:39.137577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:39.138571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 385/805] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:39.139745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306adf7d-465d-4cd8-ac99-8586acfee53a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.140030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306adf7d-465d-4cd8-ac99-8586acfee53a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.140303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306adf7d-465d-4cd8-ac99-8586acfee53a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.142576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.143607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.144162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.144642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.145660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:39.146206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.146762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 386/806] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:39.147743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306adf7d-465d-4cd8-ac99-8586acfee53a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.148421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56293b2-6a04-41e6-883b-08a79ca3aeac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.162453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 421/807] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.164056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.164583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.165088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.182142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:39.183609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:39.253978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 422/808] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:39.254962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.273344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306adf7d-465d-4cd8-ac99-8586acfee53a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.313523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.314199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.314478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.314748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.315624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:39.315929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.317380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.334918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 387/809] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.335757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.387806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f41fc-bedb-40df-b462-5115ab55c98d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.432311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.433142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.433421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.433691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.440268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc6f74-2cf9-46ad-8981-dd95d42d9335 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.440993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.442420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:39.458188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:39.459194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:39.460153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:39.464490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 423/810] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:39.465380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.479525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.480894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.481184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.481599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.482375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.484196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:39.500929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:39.503224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:39.504811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 388/811] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:39.506329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.564639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dea8f6-12b7-4128-8230-532753654550 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.604984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.605778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.606349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.606631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.620835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1ebf-ee77-412f-bbc6-94d1cff352f0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.654978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.655763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.656139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.656553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.657635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:39.658061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.660213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.681001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 389/812] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.682033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.688347 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.689828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.790624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8acc8-6567-4d13-af87-86f6b00c8ca8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.810441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 424/813] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:39.811450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.836728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.837565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.837969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.838342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.839150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:39.839552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.841038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.846190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 390/814] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.847095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.933743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce114-f03e-435d-a904-e5e6d81a5b56 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.952103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a79a04-2361-411f-851d-6eb9fcb8c824 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.967714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.968494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.968810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.969076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.979166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.980588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.992783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.993577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.993852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.994118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:39.997960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:39.999947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 425/815] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:40.001447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.005920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.007380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:40.028621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:40.030540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 391/816] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:40.032767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.104608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738d09-02db-4ab4-b57c-ff20023d93a4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.140343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.141057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.141339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.141615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.142341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:40.142647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.142881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334677d4-cb31-49e8-9fca-b5ec9d1845c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.144485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.155111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 426/817] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.155111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.185255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.186145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.186569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.186985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.187865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:40.188307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.189829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.201718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 392/818] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.202702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.254918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b565a0-eb49-4ea5-99e8-1e918c1258bf None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.291001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.291667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.291948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.292222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.293045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:40.293264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.294619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.303188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4f0f-3f23-4970-bbc5-64f784e5fd45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.306800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 427/819] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.307741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.338798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.340074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.340074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.340247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.340979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.342489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.372685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 393/820] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:01:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:40.372685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.437882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d15e5-2e1c-43dc-b015-bcd72b9ff220 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.478217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505130dd-72c3-464e-b63c-15e2313e6ffa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.484957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.486440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.486927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.487375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.497387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.498968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.516998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-0efacd62-d904-4983-9136-29eb4ef2105d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:40.517591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:40.519043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:40.520269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:40.521133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.521133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.521133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.521341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 428/821] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:40.521341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a5d0-6e93-4914-95d8-4c8e78ccd121 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.521464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a5d0-6e93-4914-95d8-4c8e78ccd121 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.521681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a5d0-6e93-4914-95d8-4c8e78ccd121 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.527278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 429/822] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:40.528317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.528449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497a5d0-6e93-4914-95d8-4c8e78ccd121 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.529856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f02ef4e1-be85-4b6a-a1e2-9e6b4d4b0b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:40.545532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:40.546674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:40.547912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 394/823] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:40.548510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.548593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.548832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.566643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:40.567837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:40.642431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497a5d0-6e93-4914-95d8-4c8e78ccd121 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.648674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 395/824] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:40.648674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.684479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.685590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.686096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.686734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.688576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:40.688904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.690538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.708026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 430/825] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.709338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.767154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cfc6c-3581-40ca-8aac-84d10185659f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.815878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.816091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb81a-0a2a-4bca-b80c-c2b54fd14000 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.816730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.816990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.817148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.818098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:40.819222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.820688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.835988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 396/826] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.837235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.851437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.852228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.852506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.852824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] PATH_INFO: `/v3/services/network` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.853474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.854829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:40.866919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:40.868760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:40.870740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 431/827] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:40.872240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.968349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79e77c-831e-4a71-9de1-31659763ff04 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.973726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460204-1b0a-468d-a0ff-359d871c5f03 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.003068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.004219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.004500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.004804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/8eb26f48e2ae4e52a9cf1ebba06bdd5b/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.010961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.011711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.012050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.012392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.013321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:41.013690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.015112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.029025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 432/828] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:41.029232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=8eb26f48e2ae4e52a9cf1ebba06bdd5b, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.029329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.029415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37406d47-eac8-460b-af3f-7e67850d91e7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.053012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 397/829] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:40 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/8eb26f48e2ae4e52a9cf1ebba06bdd5b/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:41.054808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147044c-a56c-4bcb-b6dc-a0212c582252 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.055200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147044c-a56c-4bcb-b6dc-a0212c582252 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.055483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147044c-a56c-4bcb-b6dc-a0212c582252 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.059482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 398/830] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:41.070924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.071253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.071481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.106217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:41.110845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:41.239413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572d9-734a-42a6-b34e-ca0246635680 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.251539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 399/831] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:41.279446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.280130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.280411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.280744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.281539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] RBAC: Adding query filter params (name=network) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:41.281849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.283346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.286421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.289322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 433/832] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:41.294967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.416791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7a63e-081a-412d-b558-0fa632b107e4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.421133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4483a1-2271-412a-a5b4-96a9d0720304 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.454099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.454674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.454953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.455227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.464250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.465324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.465974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.466530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.467321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:41.467651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] RBAC: Adding query filter params (type=network) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:41.468147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.469758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:41.475834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:41.476885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:41.477739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:41.479112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 434/834] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:41.480217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 400/834] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:41.481307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.483428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.592540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8d16-b723-46af-aa5f-c027fd890e55 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.606767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641a50-20b8-4394-8605-3302a4a14b81 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.627171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.627878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.628221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.628421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.629190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:41.629491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.630859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.643453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 401/835] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:41.644867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:41.649807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.651052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.652045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.652804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.653829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.655443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.684949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 435/836] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:01:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:41.768440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00252d8f-153e-45f4-8460-0b19c4d37211 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:41.818521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:41.819360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:41.819635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:41.819904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:41.837813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:41.839324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:41.863494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:41.864427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:41.865359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:41.865359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:41.865359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:41.865359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:41.868412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 402/837] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:41.870954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.015717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3b408-a9b2-4a0b-bfbd-301cecbdb1d8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.057869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.058542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.058828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.059101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.059836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:42.060138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.061531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.075185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 436/838] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:42.081220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.185290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1022c-dc6a-4dfe-8b80-90cb11c445b8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.219500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.220303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.220587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.220891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.229034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.230527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:42.244946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:42.245891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:01:42.246819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:42.250803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 403/839] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:42.252169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.351814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0378e8-a395-4989-9993-c24fe0b38116 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.385976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.386644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.386921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.387194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.388025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:42.388328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.389783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.407768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 437/840] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:42.413679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.516846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491195a4-f104-4b3a-8750-3f8d09682fbd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.551293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.551948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.552227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.552498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.621488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.622930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a60d-4445-49e2-8f1e-781a2d8a2e8f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.734300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 404/841] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:42.738243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.839008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caf313-501d-469c-bae3-e1cb224051fd None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.852238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e70e-0058-4a21-b207-916e28f1f4a8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.852687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e70e-0058-4a21-b207-916e28f1f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.852970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e70e-0058-4a21-b207-916e28f1f4a8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.855378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 405/842] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:42.860400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.860702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.860978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.874972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.875764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.876047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.876321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.878677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:42.879838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:42.887244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.888695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:42.906355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:42.908382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:42.909958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:42.909958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:42.909958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:42.909958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:42.909958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 438/843] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:42.914241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.959635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 406/844] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:42.980786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.028683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906026-7cad-4e3a-9c6a-f5cd0f44f687 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.070313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.071222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.071710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.072154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.073090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.073570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.075175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.091423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 439/845] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:43.093008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.112769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7b94-30d2-4cb8-86ec-4041433d07ea None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.153116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.154279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.154759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.155203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.156025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.157625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:43.170321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:43.171367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:43.172199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:43.180091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 407/846] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:43.181541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.203621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d45e-22fd-47de-9474-6a4d55986256 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.248885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.249696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.250129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.250410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.259687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.261755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.282179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151699ab-c99c-4ddc-8187-9562d3eeee62 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:43.282368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:43.283229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:43.289195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 440/847] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:43.291248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.327237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.327911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.328190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.328463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.329214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.329519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.331569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.337503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 408/848] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:43.343420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.406680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1af5d-0883-4457-aa9f-6d8602ccb64a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.453924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.455049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.455968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc073f-64c1-4ee4-9594-17dfc4f10d5c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.456301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.456894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.458178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.459579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.461278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.477322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 441/849] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:43.484819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.498392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.499673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.500419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.500918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.502067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.502611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.505407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252cfc-6732-40da-80d6-868d63eb2777 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.516682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 409/850] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:43.600484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236112a-74d9-4d11-97ee-b3c507780689 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.628438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389437-3f73-4cca-84ff-ebfaaa2e3f4e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.629128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389437-3f73-4cca-84ff-ebfaaa2e3f4e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.629128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389437-3f73-4cca-84ff-ebfaaa2e3f4e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.630703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 410/851] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:43.636682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a67bd-28fe-4b33-8149-0c4d5ed1adc6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.637097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a67bd-28fe-4b33-8149-0c4d5ed1adc6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.637371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a67bd-28fe-4b33-8149-0c4d5ed1adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.640320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.641034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.641316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.641593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.642437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=40e88dcd650d4783979ca3fd848203bd) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.642753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.644266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.655480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 442/852] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/role_assignments?user.id=40e88dcd650d4783979ca3fd848203bd&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:43.656233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-090a67bd-28fe-4b33-8149-0c4d5ed1adc6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:43.657572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-090a67bd-28fe-4b33-8149-0c4d5ed1adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:43.738151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 411/853] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:43.762514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.837130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b03a-8d97-4545-9ce1-844e0bce3b5e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.837622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b03a-8d97-4545-9ce1-844e0bce3b5e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.837800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b03a-8d97-4545-9ce1-844e0bce3b5e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.839193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 412/854] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:43.846072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.846806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.847164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.865001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:43.866100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:43.872116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ebc1d-005c-4c38-8910-eefff7a017a0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.918557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.919301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.919508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.919777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.930720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:43.938831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:43.940326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:43.941726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 443/855] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:43.946740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.950481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 413/856] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:43.973161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.061415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92823a-f7db-495d-8ba2-e03a239f158f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.093905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92eb87-599a-4ed8-b625-41779bdc7836 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.097229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.097513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.097889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.098258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.099180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:44.099609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.101155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.109927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 444/857] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:44.119358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.134489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.135460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.135829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.136195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.137007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.138446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:44.151129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:44.152126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:44.153274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:44.157844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 414/858] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:44.158904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.224800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f196e7-aa11-4203-996e-39f302005f3d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.259466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.260254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.260531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.260830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.261194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a056-722b-4e40-bc0c-d61122620a9c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.272194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.274241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:44.296241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:44.297266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:44.298171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:44.298171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:44.298171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:44.298171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:44.298392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.298392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.298392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.298600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 445/859] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:44.298669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.298669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:44.299086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.300573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.303302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.309920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 415/860] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:44.311026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.422157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ce0a9-ad1c-49f1-a093-e1afa8b44711 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.426223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d7e6-3903-4ee2-ba63-63b27e5011ef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.461615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.462431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.462809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.463195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.464015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:44.464410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.465893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.466495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.467155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.467429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.467859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.469042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:44.469350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.470693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.480735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 416/861] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:44.487856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 446/862] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:44.493844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.604669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae185b2-fd3f-474d-8ab2-2283b3565ebf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.640687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.641576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.641757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.642041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.650498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.651959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:44.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:44.670901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:44.673116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 417/863] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:44.680676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.777984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005c661-29a2-44d3-a380-c7848d24eca7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.810778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.811548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.811829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.812099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:44.813021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:44.813323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:44.815336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:44.833415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 447/864] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:44.838642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:44.944943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65690923-9d0e-47fd-ab43-9ddbbc3b7967 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:44.978539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:44.979188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:44.979467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:44.979739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.053098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.053098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.147944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 418/865] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:45.153740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.251639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e665b4a-0bed-4255-8735-5a93205f11db None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.286494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.287285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.287559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.287823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.298097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.300233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:45.317463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:45.319496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:45.321670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:45.321670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:45.321670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:45.321670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:45.321670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 448/866] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:45.324165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.425302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f6e9-6f9e-4bba-8aba-890d5113dded None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.458550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.459222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.459500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.459772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.460488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:45.460820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.462175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.474347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 419/867] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:45.479688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.577034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35ada-980d-4a96-a486-4eb1f2325bcf None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.609892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.610688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.610968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.611241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.618935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.620407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:45.634453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:45.636497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:45.638638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 449/868] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:45.642371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.749729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef407-2277-4de3-8eb9-956e305d050f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.784918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.785631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.785910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.786188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.786974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:45.787281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.788792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248416-85e8-4100-9329-87d5e1ef3047 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.801546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 420/869] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:45.807355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.910597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1d461-1813-43fa-a718-af97fe522fc3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.936541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ffcc-6bd8-4b3c-bb03-189d62553523 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.936880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ffcc-6bd8-4b3c-bb03-189d62553523 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.937130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007ffcc-6bd8-4b3c-bb03-189d62553523 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.938731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 421/870] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:45.944696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0444d-7e96-4051-af7b-fd2498cfdb53 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.944992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0444d-7e96-4051-af7b-fd2498cfdb53 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.945264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0444d-7e96-4051-af7b-fd2498cfdb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.945771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.946474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.946732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.947009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.947877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:45.948187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.949628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.955860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 450/871] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/role_assignments?user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:45.971826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-64f0444d-7e96-4051-af7b-fd2498cfdb53 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:45.973063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-64f0444d-7e96-4051-af7b-fd2498cfdb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:46.050700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 422/872] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:46.067205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:46.095067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933dfd-5db9-48c0-a9fd-d1dbc87972c5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.095520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933dfd-5db9-48c0-a9fd-d1dbc87972c5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.095682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933dfd-5db9-48c0-a9fd-d1dbc87972c5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.097851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 423/873] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:46.103239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.103650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.103812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.124563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:46.126157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:46.183461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584c25-4ab8-4a88-8fad-010c368528b0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:46.216790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 424/874] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:46.224389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:46.225083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.225364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.225632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.226344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:46.227724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:46.238330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:46.252728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 451/875] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:46 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:46.371497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609f98-8d6b-40ff-9fbe-46e5c7beaa29 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:46.418057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:46.419268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.419758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.420252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.421183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:46.422798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:46.436643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:46.437714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:46.438546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:46.441913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 425/876] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:46.448125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:46.555199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961dbf2-0872-4a43-b01c-3dedb8e1d699 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:46.588450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:46.589139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.589416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.589684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.590390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:46.590689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:46.592028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4239b7-3992-4e0d-a4c8-ea8454fb8fc5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:46.600763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 452/877] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:46.602659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:46.711636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50321d-2a92-431f-9a37-983e947ef1fe None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:46.745090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:46.745753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.746028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.746297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.746999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:46.747297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:46.748644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae9d-5cb0-46de-8c5c-520fbcf77534 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:46.759435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 426/878] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:46.822706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def8ba-be40-4160-920c-a1a03f979114 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.823023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def8ba-be40-4160-920c-a1a03f979114 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.823246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def8ba-be40-4160-920c-a1a03f979114 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.824943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 453/879] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:46.831234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d598c4-2773-473a-8e36-ff4e0d4e4bff None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.831543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d598c4-2773-473a-8e36-ff4e0d4e4bff None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.831774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d598c4-2773-473a-8e36-ff4e0d4e4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.849482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e3d598c4-2773-473a-8e36-ff4e0d4e4bff None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:46.850673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e3d598c4-2773-473a-8e36-ff4e0d4e4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:46.926357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 427/880] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:46.949285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def8ba-be40-4160-920c-a1a03f979114 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:47.053899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def8ba-be40-4160-920c-a1a03f979114 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:47.088227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:47.088914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:47.089191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:47.089463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:47.090174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:47.091519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b619-65ad-4b1f-98a8-8a7237b2ccdb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:47.107470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 454/881] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:46 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:48.419950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fb94-5300-4c06-8584-0ed04b596d63 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.420838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fb94-5300-4c06-8584-0ed04b596d63 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.421281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fb94-5300-4c06-8584-0ed04b596d63 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.423034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 428/882] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:48.428945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29dee-24a7-4905-adf2-7c016dd8f6f2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.429792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29dee-24a7-4905-adf2-7c016dd8f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.430215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29dee-24a7-4905-adf2-7c016dd8f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.449154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-74d29dee-24a7-4905-adf2-7c016dd8f6f2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:48.450652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-74d29dee-24a7-4905-adf2-7c016dd8f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:48.529531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 455/883] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:48.553006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90fb94-5300-4c06-8584-0ed04b596d63 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.629710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6b748-93bf-467d-a265-4eac30906e13 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.630360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6b748-93bf-467d-a265-4eac30906e13 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.630854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6b748-93bf-467d-a265-4eac30906e13 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.632707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 456/884] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:48.637439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.637725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.638246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.656364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:48.657842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:48.660715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90fb94-5300-4c06-8584-0ed04b596d63 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:48.698060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:48.699115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.699636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.700105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.711563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:48.720232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:48.721397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:48.722243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:48.725003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 429/885] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:48.732226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.737191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 457/886] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:48.762412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.849360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d56a0-2a4e-42ef-a86c-601fc67802f3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:48.860196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655261d5-3d64-4940-9f82-f93d5742dd51 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:48.884427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:48.885459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.885896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.886350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.887289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:48.887871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:48.889568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:48.898963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:48.904714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.904942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 430/887] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:48.905047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.905047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.905047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:48.905047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:48.906706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:48.922865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:48.924521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:48.925607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:48.928740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 458/888] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:48.931682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.032459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55f3f-9c49-4769-b832-8b13245ae8da None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.052821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e097b-7015-4e03-b173-ff388ee1417a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.082346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.083411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.083839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.084257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.094766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.095435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.095623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.096341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.096683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.097399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:49.097707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.097801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.099041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31438f2-8944-4b7c-9fee-48bb66d8a07f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.104725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 459/889] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:49.104859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76a68-933e-44a7-9536-5927e5085445 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.106770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76a68-933e-44a7-9536-5927e5085445 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.106770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76a68-933e-44a7-9536-5927e5085445 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.106770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 460/890] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:49.114471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.114759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.115031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:49.115440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:49.116281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:49.117206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:49.117206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:49.117206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:49.117206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:49.117206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 431/891] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:49.117487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.138942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:49.140210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:49.207378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 461/892] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:49.214338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.219109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda789-f2cd-4a13-afa6-af4f05214019 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.252781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.253875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.254332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.254772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.255670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:49.256143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.257691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.263135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 432/893] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:49.264134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.320865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33613b-b9f7-448e-95fe-102a37745c02 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.358175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.358929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.359392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.359561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.360257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:49.360560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.362430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c235-fe3b-48af-b8a4-348d9de9f6c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.362859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.378044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 462/894] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:49.378888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.403293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.403946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.404223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.404494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.405242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.406590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.419338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 433/895] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:49 2022] POST /identity/v3/services => generated 241 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:49.420111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.487242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b157cb-08b3-456f-a57e-f27221f43f1f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.525584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.526246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.526524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.526795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.527846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] RBAC: Adding query filter params (interface=public, service_id=3ee90f9eecc44ed0858afea4794bf527, region_id=RegionOne) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:49.528156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.529569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb6c4-7ed1-4b37-9d13-c9cc5705cd0c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.530790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a00b4-71e2-4073-8ca9-fcbd3337e68b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.535804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 463/896] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/endpoints?service_id=3ee90f9eecc44ed0858afea4794bf527&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:49.537547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26982e7-d3b6-4f44-8a56-7a83631843ff None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.538071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26982e7-d3b6-4f44-8a56-7a83631843ff None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.538651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26982e7-d3b6-4f44-8a56-7a83631843ff None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.546935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 464/897] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:49.546935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26982e7-d3b6-4f44-8a56-7a83631843ff None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.568216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.569077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.569355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.569631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.577723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.579115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-37e36b61-944a-488c-a0b3-6642bc7a14e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:49.594876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:49.596178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:49.597349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:49.602228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 434/898] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:49.603284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.603573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.603851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.620803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:49.621952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:49.651162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26982e7-d3b6-4f44-8a56-7a83631843ff None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.685112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.686045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.686323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.686594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.687261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.688702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.688995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 435/899] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:49.690509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.705242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 465/900] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:49.714002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.800785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743862c7-c897-4c1b-8978-956a8ea4b3ec None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.836993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.837650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.837976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.838242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.839103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:49.839415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.840916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.853740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a625ca-582e-4ef0-8d4a-255a082e3f4a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:49.861529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 436/901] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:49.873814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.895880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:49.897585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:49.898169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:49.898691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:49.899502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:49.901391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:49.915091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:49.916047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:49.917338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 466/902] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:49.922488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:49.997495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccf1c-790c-4389-bfaa-3302000b60bf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.040930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d7c5-a76f-4c76-8b94-a8917f9e1f85 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.042304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.043271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.043615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.043967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.084338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.085343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.085804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.086273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.087223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:50.087749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.089404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.094607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 467/903] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:50.100286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.132177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.134757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.215730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901374-07f0-4fda-9c79-bc7521a28cf4 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.257545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.262588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.263647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 437/904] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:50.265271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.272699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 468/905] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:50.278659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.385501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926de4-89c1-480f-b187-cb9c710c221e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.394806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951e2e-3a47-46c3-adc2-20af6080d4e3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.418840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.419493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.419767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.420035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.421074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] RBAC: Adding query filter params (interface=public, service_id=cff4554841a145c1b2bb4b9afad7f5c8, region_id=RegionOne) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:50.421198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.422467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.432799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 469/906] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/endpoints?service_id=cff4554841a145c1b2bb4b9afad7f5c8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:50.433764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.437019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.438390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.438893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.439401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.450636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.452498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:50.470567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:50.471963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:50.472972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:50.472972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:50.472972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:50.472972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:50.479530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 438/907] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:50.480603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.532863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d719-4798-4662-a831-23ec158d6b48 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.567704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.568453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.568637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.569006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.569730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.571161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.585140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 470/908] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:50.592725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8664-89d3-4d7e-b5dd-244ff1ecac0d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.631555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.632520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.632993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.633422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.634326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:50.634789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.636429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.650362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 439/909] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:50.656451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.764533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237168-d607-49c5-a495-111d008cdac5 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.801245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.802493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.802777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.803052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.809997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.811423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:50.825614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:50.826548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:50.827441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 471/910] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:50.832864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:50.937045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562d88f-13c1-4f10-87c0-7f7572d5ab4e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:50.971747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:50.972464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:50.972774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:50.973044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:50.973882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:50.974191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:50.975625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bddf-9959-4b08-b8a7-377a4df2b0fe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:50.992915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 440/911] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:50.994940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.098824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f82865-755e-4090-9eb2-98298f0365b8 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.135813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.136879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.137452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.137931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.138989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] RBAC: Adding query filter params (role.id=2e2f9a2486744c878550df3305017bab, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:51.139539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:51.141178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9134b72-e42f-4ad3-aff6-8dfb65f44315 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:51.147714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 472/912] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:01:50 2022] GET /identity/v3/role_assignments?user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=2e2f9a2486744c878550df3305017bab => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:51.733903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29439f-6bbd-4040-9cd7-590cd7f5e6d4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.734448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29439f-6bbd-4040-9cd7-590cd7f5e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.734448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29439f-6bbd-4040-9cd7-590cd7f5e6d4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.736029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 441/913] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:51.741805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26897a-621b-4c0a-873b-66268e3c5a82 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.742243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26897a-621b-4c0a-873b-66268e3c5a82 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.742428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26897a-621b-4c0a-873b-66268e3c5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.762787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6c26897a-621b-4c0a-873b-66268e3c5a82 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:51.763938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6c26897a-621b-4c0a-873b-66268e3c5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:51.839019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 473/914] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:51.861059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29439f-6bbd-4040-9cd7-590cd7f5e6d4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.964589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29439f-6bbd-4040-9cd7-590cd7f5e6d4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.999233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.999955 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.000233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.000561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.001246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.003477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.012042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb21a9-fa0b-439b-a526-9f845ab2d33f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.012317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb21a9-fa0b-439b-a526-9f845ab2d33f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.012592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb21a9-fa0b-439b-a526-9f845ab2d33f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.015396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 474/915] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:52.015515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:52.016485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:52.017380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 442/916] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:52.019608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.019889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.020161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.025609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.037632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:52.038817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:52.112762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 475/917] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:52.127159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.134595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8659eb-1135-4631-808a-5eccd75b5f46 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.169382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.170047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.170327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.170600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.171303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.171605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.172997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.178082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 443/918] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:52.183642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.246069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ba65c-462e-478d-a96d-7b2fd99eed85 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.288382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.289151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.289432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.289704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.290369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.291744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:52.305024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:52.306041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:52.306872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 476/919] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:52.308473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd8d00-1911-4078-8286-b24be5e6e51b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.312047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.353959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.354629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.354908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.355177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.355882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.356188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.357568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.364504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 444/920] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:52.370038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.432844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0bc5-175e-4801-92b2-1947ea775c10 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.473142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.473959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.474330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.474699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.475505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.475908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.477388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.487572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 477/921] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:52.488926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.501085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee67b9-e81f-4d8a-b932-5711973a70c5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.539031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.539762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.540134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.540547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.541493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] RBAC: Adding query filter params (interface=public, service_id=9e4ca18808bf434583fc187e237670b0, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.541895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.543346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.549409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 445/922] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/endpoints?service_id=9e4ca18808bf434583fc187e237670b0&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:52.557269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.603389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d7940-7c8d-4684-aea5-8e921925dd89 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.637429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.638289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.638682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.639024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.639901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.640212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.641679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.651300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 478/923] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:52.652836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.656307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60a4b-446e-4a8d-851c-6497fa6b8e63 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.690650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.691620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.692078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.692548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.693448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.695007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707fea8-830e-4bf4-89c5-432a79b6a064 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.708794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 446/924] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:52.759072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bd06-ff55-4f5c-a121-7661ca12e526 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.798702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.800179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.800509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.800826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.801595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.803014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c08c09-9b90-488b-b5c9-904032838348 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.832897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 479/925] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:01:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:52.989809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2a96-9d23-4d97-b730-c15a55f28641 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.990819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2a96-9d23-4d97-b730-c15a55f28641 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.991314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac2a96-9d23-4d97-b730-c15a55f28641 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.993247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 447/926] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:52.999233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.999872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.000362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.018623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:53.020155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:53.143607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 480/927] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:53.185754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac2a96-9d23-4d97-b730-c15a55f28641 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.324170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac2a96-9d23-4d97-b730-c15a55f28641 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:53.389045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:53.389864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.390135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.390401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.391051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:53.398131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-139525f5-c0df-4b1f-ab4e-4b53d6ba60e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:53.414786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:53.415792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:53.416680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 448/928] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 10 03:01:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:53.427956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.454325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3714-7abd-4736-853a-51f863c23065 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.454630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3714-7abd-4736-853a-51f863c23065 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.454897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3714-7abd-4736-853a-51f863c23065 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.456510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 449/929] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:53.461680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.461963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.462239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.480230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:53.481451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:53.592777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 450/930] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:53.604677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec229-d9a2-4e26-9423-f5325c41bf41 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:53.617932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.650212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:53.656675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:53.668515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 481/931] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:53.673356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.761156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da7df-ea58-4a45-9735-242f9f323ddd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:53.789626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc17-e553-4b21-b5a2-f661575a1f7e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:53.809874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:53.810840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.811220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.811581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.824961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:53.827238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:53.827892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:53.828167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:53.828435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:53.829167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:53.829465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:53.831075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:53.835489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:53.836638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:53.837535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:53.838199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 482/932] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:53.842455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 451/933] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:01:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:53.843478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.843782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:53.953069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca991c4-345a-472d-8abc-bb92fcbfa024 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:53.968183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f3c98-cb22-4c32-bee8-b7fab2dfd9d0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.000255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.001124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.001498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.001909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.002481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.002937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.003720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.004140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.004500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.004744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.005780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:54.006229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.007884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.023368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 452/934] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:01:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:54.024934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.028727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 483/935] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:01:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:54.149781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c217eea-c0f9-4018-9ba4-f51d396d0e43 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.192091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.192985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.193264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.193534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.205546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.207109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:54.225939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:54.226951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:54.227837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:54.227837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:54.227837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:54.227837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:54.227837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 453/936] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:54.234321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.340360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf885-54b0-4b96-b061-b7e80bc2e209 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.373626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.374647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.375146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.375681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.377291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:54.378252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.379843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.393339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 484/937] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:54.398675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.496971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8b8e-81a4-42f3-8c8e-666ae5615729 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.531259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.532435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.532965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.534455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.542469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.544341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:54.559785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:54.560826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:54.561801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:54.565667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 454/938] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:54.571788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.672978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa5b0-603a-49c2-9b90-b0a3130f774d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.711189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.712093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.712514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.712983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.713948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:54.714409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.715968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.738799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 485/939] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:54.740366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.853250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517103e-454b-4d56-973b-71b4f2e6deb8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.891403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.892476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.892940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.893374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.905560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.907241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-340d9f43-2dfc-48ec-9c43-ea9a8a58afc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:54.927282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:54.928422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:54.929557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:54.929557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:54.929557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:54.929557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:54.935700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 455/940] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:54.937831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.040980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfed6b-1cb5-43ce-8704-922ea9002050 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.045220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfed6b-1cb5-43ce-8704-922ea9002050 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.045220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfed6b-1cb5-43ce-8704-922ea9002050 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.045220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 456/941] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:55.048864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.049155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.049432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.071327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93bca2-254b-4da3-a93d-d0653df40cf3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.073614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:55.074791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:55.121568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.123086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.123561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.124037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.125437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:55.125975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.129549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.150213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 486/942] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:55.156307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.168687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 457/943] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:55.193000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.278660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370aa14-cd1a-42b2-b90e-779bcb3b53f1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.315171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.316383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.316922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.317398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.320954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d13e-1b9a-4d3a-ac9a-3c53c5a46616 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.325257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.326937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:55.342403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:55.343395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:55.344298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:55.353140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 487/944] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:55.354652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.365213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.366755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.367045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.367322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.367988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.370113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9a1cf8ff-934a-44de-899a-f2b9f6f7d538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:55.385329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:55.386362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.387230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 458/945] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:55.388562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e54-9545-45c4-9c7a-99b22254d350 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.388562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e54-9545-45c4-9c7a-99b22254d350 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.388914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e54-9545-45c4-9c7a-99b22254d350 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.390854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 459/946] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:55.393001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198e54-9545-45c4-9c7a-99b22254d350 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.480079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b144f2f-2d57-44f2-b04e-d31ca815dccd None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.507676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198e54-9545-45c4-9c7a-99b22254d350 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.515594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.517045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.518114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.518637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.519973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:55.520843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.522951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89981e10-573f-4de1-b7c5-a20407f7cac6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.539165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 488/947] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:01:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:55.541246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.542032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.542759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.546952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.547620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.547896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.548168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.548932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:55.549318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.550682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.555399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 460/948] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:55.556145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.562094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:55.564417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:55.632224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 489/949] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:55.636995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.685434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170a9-c6f0-47bf-86df-212de48adb8a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.718599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.719489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.719766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.720038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/8eb26f48e2ae4e52a9cf1ebba06bdd5b/roles/2e2f9a2486744c878550df3305017bab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.722399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=8eb26f48e2ae4e52a9cf1ebba06bdd5b, role_id=2e2f9a2486744c878550df3305017bab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.723821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.748684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 461/950] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:01:55 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/8eb26f48e2ae4e52a9cf1ebba06bdd5b/roles/2e2f9a2486744c878550df3305017bab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:55.748684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.766956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10f97-48ea-4ad0-882a-24f81943ad23 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.812624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.813466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.813750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.814023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.815351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:55.815664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.817102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.822981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 490/951] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:55.828471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.894623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff945e-8bb7-43c9-80ad-9c36653fb7c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.941614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.942598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.943050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.943511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.944389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.946109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.947639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING keystone.server.flask.common [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 03:01:55.948709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14b94-4452-4ee9-bcae-e8dbe3573209 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.972814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:55.972814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 03:01:55.972814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [parameters: {'id': '088efa58477642aa9d0f5d5d51902424', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 03:01:55.972814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:01:55.985323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.985988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.986293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.986612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.987460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.989111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 088efa58477642aa9d0f5d5d51902424.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 088efa58477642aa9d0f5d5d51902424. May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:55.990621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 03:01:55.991427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() May 10 03:01:55.992379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:01:55.993311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:01:55.994237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:55.995034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'id': '088efa58477642aa9d0f5d5d51902424', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.995895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:55.997996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 088efa58477642aa9d0f5d5d51902424. May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:56.006210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 462/952] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 10 03:01:55 2022] POST /identity/v3/projects => generated 262 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:56.008098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:56.024781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 491/953] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:01:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:56.125622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f404d-2249-4d6d-9eaf-0434df807120 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:56.174001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:56.174723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.174998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.175263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:56.183016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:56.184634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9996e00d-611f-437f-a7be-d1678860ffa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:56.199543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:56.200502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:56.201489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 463/954] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:56.209806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:56.316152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eac2e3-fa90-4974-b308-8345963eeb19 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:56.349227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:56.350262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.350742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.351219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:56.352192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:56.352707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:56.354340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5e72c-4ed1-423f-b1df-7739ded3a3e6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:56.372479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 492/955] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:56.584638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc2a2-f21d-4e78-91f6-8bd7c5fbe8b6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.584975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc2a2-f21d-4e78-91f6-8bd7c5fbe8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.585340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc2a2-f21d-4e78-91f6-8bd7c5fbe8b6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:56.587001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 464/956] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:56.592495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.592839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.593123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:56.610462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:56.611801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:56.684767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 493/957] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:56.702313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc2a2-f21d-4e78-91f6-8bd7c5fbe8b6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:56.803548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc2a2-f21d-4e78-91f6-8bd7c5fbe8b6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:56.836615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:56.837395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.837670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.837989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:56.838642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:56.839994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:56.852339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:56.853375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:56.854211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 465/958] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:01:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:56.860017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:56.962075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069222b-acef-407f-bf46-5bb04de1bd21 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:56.997733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:56.998763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:56.999245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:56.999774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.000722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:57.001225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:57.003484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181659e2-483f-42a6-9cc4-c2d4a7fb3d4e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:57.008681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 494/959] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:57.020702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:57.117414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965d78-f640-4872-b96d-91ade9eeabf4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:57.149644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:57.151057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:57.151575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:57.152040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.153229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:57.153727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:57.155269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de429d-bfc4-4d4f-a17f-81ade4723f28 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:57.160914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 466/960] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:01:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:58.067471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb26ea7-2239-4c05-89f5-4a0cd0701ca8 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.067918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb26ea7-2239-4c05-89f5-4a0cd0701ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.068112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb26ea7-2239-4c05-89f5-4a0cd0701ca8 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.069692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 495/961] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:58.074990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.075507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.075981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.093884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:58.095701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:58.163772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 467/962] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:58.187306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb26ea7-2239-4c05-89f5-4a0cd0701ca8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.299210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb26ea7-2239-4c05-89f5-4a0cd0701ca8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.335064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.336305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.336841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.337311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.348244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-28c595ab-683c-432e-97bf-47bf2d062a7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:58.356609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:58.357594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:58.358437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:58.365007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 496/963] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:58.368594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.425490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325270-9a1a-413d-8ab3-fcb68386280b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.426118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325270-9a1a-413d-8ab3-fcb68386280b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.426596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325270-9a1a-413d-8ab3-fcb68386280b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.428424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 497/964] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:58.433867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.434400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.434879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.456863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:58.458859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:58.474177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d765132-2051-4b94-8ee3-5f7b813f5510 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.508584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.509621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.509621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.509838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.510574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:58.510876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.512365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.525236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 468/965] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:58.527221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.548926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 498/966] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:58.567564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.653826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f6f63-f23b-45c7-8bdb-de047f234c61 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.670999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67ce95-005f-4429-9789-d4bf76d619e6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.689832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.690628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.690905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.691175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.705054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.706751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.710156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.711230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.711721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.712192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.713103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.714648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:58.725507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:58.726414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:58.727298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:58.727298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:58.727298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:58.727298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:58.727298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 469/967] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:58.733366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:58.734339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:58.735184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 499/968] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:58.736519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.745811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.846585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6009-c6d5-4781-b1b3-5eaf75d38f89 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.852707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c1ac5-8e49-49f0-b16b-738eb3acbd65 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.881058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.881719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.882013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.882284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.882988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:58.883290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.884640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808aaf3-09f7-4fde-bced-dfbd08b143ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.886082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.886739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.887018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.887289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.887984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:58.888287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.889655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59872df-2236-4d99-b2b0-b6e75abba22d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.899617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 500/969] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:58.899617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369f8f-7dbe-4d97-8b38-8ac3a260344f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.899617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369f8f-7dbe-4d97-8b38-8ac3a260344f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.899617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369f8f-7dbe-4d97-8b38-8ac3a260344f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.899617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 501/970] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:58.905969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 470/971] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:58.906104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6369f8f-7dbe-4d97-8b38-8ac3a260344f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.906215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.906215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.906215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.921749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:58.922906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:58.987427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 471/972] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:58.988755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.018677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6369f8f-7dbe-4d97-8b38-8ac3a260344f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.060094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.060791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.061075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.061348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.062221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:59.062388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.063731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.074405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 502/973] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:59.074405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.099821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e141-fecb-4153-939d-98155577c194 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.134327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.135124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.135399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.135668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.145513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.147029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:59.162561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:59.163526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:59.165529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:59.168375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c89f3-37e2-4797-b8d4-1125ebb0f110 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.168499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 472/974] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:59.169323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.204478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.205840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.206211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.206489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.207249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.208702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.210047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING keystone.server.flask.common [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 03:01:59.223750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.sql.core [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:59.223750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 03:01:59.223750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [parameters: {'user_id': '2065b72d773b43ec815a93a8afbd39b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 03:01:59.223750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80056) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result.read() May 10 03:01:59.231236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:59.232125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application yield resource May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise self.value May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application session.commit() May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:01:59.233211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.session.flush() May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application compat.raise_( May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:01:59.234112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:59.234984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application result.read() May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:59.235817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [parameters: {'user_id': '2065b72d773b43ec815a93a8afbd39b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:59.238853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 03:01:59.240805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 503/975] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 10 03:01:59 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:59.242044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.284466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741bff-d292-4ef5-97b0-5d1341bfeb58 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.317649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.318319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.318596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.318881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.319651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] RBAC: Adding query filter params (interface=admin, service_id=9e4ca18808bf434583fc187e237670b0, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:59.319957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.321337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.326527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 473/976] 10.222.0.55 () {56 vars in 1249 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/endpoints?service_id=9e4ca18808bf434583fc187e237670b0&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:59.331643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.341033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f71fe-15e3-4283-8332-9ec2d6652af9 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.377507 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.378314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.378626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.378880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.379725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:59.380034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.382031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.403157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 504/977] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:59.403962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.426707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c92c-3fec-4c4e-8eec-2da5d38012f6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.458210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.458992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.459270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.459540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.466159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.467573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-19fc5a2b-b07b-4ea4-b051-2cc558fe7aa4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:59.482036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:59.483064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:01:59.484186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 474/978] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:59.484933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9cf8-701e-41b9-9655-dc2afbe8d22c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.485005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9cf8-701e-41b9-9655-dc2afbe8d22c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.485212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9cf8-701e-41b9-9655-dc2afbe8d22c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.486869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 475/979] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:59.487386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9cf8-701e-41b9-9655-dc2afbe8d22c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.505661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f2be1-fb26-4eb2-bd6a-aa92a06a778c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.538306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.538962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.539238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.539512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.540180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.541568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.547461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 505/980] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:59.548152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.590844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9cf8-701e-41b9-9655-dc2afbe8d22c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.631426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.632090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.632415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.632715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.660883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce0661-df27-4a11-ac6e-73902edc5257 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.697266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:59.697958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.698240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.698518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.699341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:59.699654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.701155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b7399-fa19-43c2-b718-fdfbe764bd28 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.708884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:59.710690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:59.748681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 506/981] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:59.748681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:59.748681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:59.748681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:59.760253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:59.761879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:59.855931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 507/982] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:01:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:59.863543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 476/983] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:59.869381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.883356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:59.984327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf492-9b88-459d-a862-d0814bf0dab8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:59.998833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae1429-8b17-461b-b9e5-b4c3257b4736 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:00.028873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.029669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.029951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.030233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.041240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.041983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.042434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.042553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.043180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.043297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.044582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.044753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.069026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 477/984] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:01:59 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:00.072232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:00.073407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:00.074939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:00.074939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:00.074939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:00.074939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:00.078141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 508/985] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:00.079862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:00.194886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4bf1-7e61-4b36-8796-beca6e314c66 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:00.229963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.230641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.230917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.231187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.231913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:00.232215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.233634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.250802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 478/986] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:00.253305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:00.353496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72b2e8-ff34-4af7-8bb4-a7b1e31d6386 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:00.387153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.387940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.388213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.388483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.395764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.397216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:02:00.410726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:00.411818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:00.412927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 509/987] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:00.417762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:00.514570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e362bcf-a660-4fb0-8611-ac81c30a4047 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:00.547663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.548355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.549261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.549571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.550354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:00.550662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.552097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c25851-6970-42ad-adc9-9046194c12fe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.563318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 479/988] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:00.569410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:00.664961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31dd4a-ace4-4ded-9c53-7f4ba560b7f6 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:00.697962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:00.698616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.698899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.699173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.700004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] RBAC: Adding query filter params (role.id=2e2f9a2486744c878550df3305017bab, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:00.700316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:00.701763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b0e5-a7c7-4a0f-b527-0c6fceb6bc6f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:00.712670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 510/989] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:00 2022] GET /identity/v3/role_assignments?user.id=8eb26f48e2ae4e52a9cf1ebba06bdd5b&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=2e2f9a2486744c878550df3305017bab => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:01.856310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255427e-a925-425b-a599-086d1288e009 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:01.856923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255427e-a925-425b-a599-086d1288e009 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:01.856923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255427e-a925-425b-a599-086d1288e009 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:01.858319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 480/990] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:01.864823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:01.865262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:01.865429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:01.882535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:01.882535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:01.946784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 511/991] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:01.969656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255427e-a925-425b-a599-086d1288e009 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.069506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255427e-a925-425b-a599-086d1288e009 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.101484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.102285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.102562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.102830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.103477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.104848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:02.117209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:02.118207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.119061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 481/992] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 10 03:02:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:02.125872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.218752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20532a-64aa-4e33-99ff-a537d6eb8d70 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.254703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.255372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.255649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.255919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.256632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:02.256964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.258313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.267996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 512/993] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:02:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:02.268962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.365065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7900-6817-45e1-8dae-4bfcf3e0c636 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.397168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.397756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.398033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.398333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.399006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:02.399309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.400684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb15cc-0bf7-4bad-ba62-e39138ef2f5b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.410757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 482/994] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 10 03:02:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:02.411995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.416774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bd54-491e-4a6d-ab32-f7f4cea637f6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.417064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bd54-491e-4a6d-ab32-f7f4cea637f6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.417339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bd54-491e-4a6d-ab32-f7f4cea637f6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.418844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 483/995] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:02.424405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.424737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.425022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.441590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:02.442904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:02.510277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 484/996] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:02.515521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293e1ef-38bf-40cc-b61c-d0c3123ed733 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.532470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.550614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.551276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.551553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.551825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.552570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.553939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.569444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 513/997] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:02:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:02.643089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9103-a411-4a97-a12c-46bc22722177 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.686206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.687318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.687774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.688221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.689287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.691077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:02.703568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:02.704877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:02.705889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:02.708824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 485/998] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:02.712241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.820515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9f03-2f09-455a-8572-7fdb17823b51 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.852813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.853469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.853751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.854020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.854711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:02.855017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:02.856363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e70b-1f1e-49ff-a618-f14eae1e86eb None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:02.861743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 514/999] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:02:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:02.867166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:02.963792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb93f-0054-4af3-b62d-9c80a4f09846 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:02.971755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d910-6947-4f5f-a844-a84be2ce88de None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.972291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d910-6947-4f5f-a844-a84be2ce88de None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.972291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d910-6947-4f5f-a844-a84be2ce88de None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.973817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 515/1000] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:02.978716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.978997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.979267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.995620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:02.996814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:02.997627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:02.998289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:02.998567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:02.998842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:02.999539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:02.999837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.001306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.006314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 486/1001] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:02:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:03.011689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.070230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 516/1002] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:03.092437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.112053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c6b2-58cd-431c-90ee-11e445b39c91 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.147176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.147837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.148131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.148400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.149216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] RBAC: Adding query filter params (interface=public, service_id=858af9fc609440a3a435d7a710345a54, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:03.149522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.150883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.156241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 487/1003] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:02:03 2022] GET /identity/v3/endpoints?service_id=858af9fc609440a3a435d7a710345a54&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:03.162411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.189879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11574e05-1e6a-4f7c-98bb-cd8eb8defa6c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.223703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.224417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.224719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.224994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.225638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.226995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:03.238263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:03.239283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:03.240131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:03.241767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 517/1004] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 10 03:02:03 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:03.245445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.263519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6a94-9f69-48cc-8e6e-84c5bc1e3fbc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.296607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.297295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.297577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.297846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.298555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.299942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.306285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 488/1005] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:02:03 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:02:03.348372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c603649-d9f0-4808-8645-dc0809e292e2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.384286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.384986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.385265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.385536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.386252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] RBAC: Adding query filter params (name=image) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:03.386561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.387942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5a917-684a-42f2-b6d1-19e5ffcf731d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.398808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 518/1006] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:03.400497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.502879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83980ba-acd4-4ce3-a146-eca18a0e85cd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.536031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.536752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.537010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.537280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.537985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:03.538283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.539632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b74609-38da-47e8-be7b-d1f349392e89 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:03.544153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 489/1007] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:04.830827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509d52-4cab-4061-93c4-da83720a84c9 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:04.831355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509d52-4cab-4061-93c4-da83720a84c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:04.831355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509d52-4cab-4061-93c4-da83720a84c9 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:04.832909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 519/1008] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:04.837939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:04.838330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:04.838488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:04.855399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:04.856564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:04.920073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 490/1009] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:04.943273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1509d52-4cab-4061-93c4-da83720a84c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:05.039447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1509d52-4cab-4061-93c4-da83720a84c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:05.073469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:05.074260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.074537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.074807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.075952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:05.077386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829cff-bd0a-48c9-8ef9-1398f03ab343 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:05.084192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 520/1010] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:05.085373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:05.179650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8864617-dd69-4049-8885-f5ed5d0b2111 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:05.212720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:05.213378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.213653 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.213921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.214628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:05.216041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15c99-49e7-414a-943a-b2af8c932da2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:05.248674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 491/1011] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:02:05 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:05.568298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad04-90ee-449d-931a-8f2535d9b708 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.568680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad04-90ee-449d-931a-8f2535d9b708 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.568913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad04-90ee-449d-931a-8f2535d9b708 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.570415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 521/1012] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:05.575534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9850-11ab-4661-b354-d2ead6db5b3d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.575820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9850-11ab-4661-b354-d2ead6db5b3d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.576093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9850-11ab-4661-b354-d2ead6db5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.593963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1add9850-11ab-4661-b354-d2ead6db5b3d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:05.595539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1add9850-11ab-4661-b354-d2ead6db5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:05.666024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 492/1013] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:05.689519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bad04-90ee-449d-931a-8f2535d9b708 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:05.787131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bad04-90ee-449d-931a-8f2535d9b708 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:05.788680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02128419-221b-47f5-87b8-18f227a28dd2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.788989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02128419-221b-47f5-87b8-18f227a28dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.789271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02128419-221b-47f5-87b8-18f227a28dd2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.790782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 493/1014] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:05.795543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.795826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.796102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.813710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:05.814874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:05.822649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:05.823382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.823659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.823927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.824569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:05.825935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:05.837640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:05.839090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:05.839953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 522/1015] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:05.844770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:05.881821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 494/1016] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:05.905045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:05.942985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71081f-a3dc-4042-a64b-e3cd71da0ebd None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:05.976584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:05.977264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:05.977547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:05.977817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:05.978515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:05.978818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:05.980169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:05.985020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 523/1017] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:02:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:05.990472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:06.001531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6ed4-6569-41b9-bb58-37e4b8e0af47 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:06.035617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:06.036281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.036551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.036870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.037559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:06.038909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:06.057049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 495/1018] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:02:05 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:06.099316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8bd65-3211-4a39-bc43-76bab5f15e71 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:06.141706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:06.143472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.143990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.144469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.145416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:06.145925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:06.147536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266199-7ec2-4dd6-826e-27e2ab407bf6 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:06.158777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 524/1019] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 10 03:02:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:06.160360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:06.261092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43600a-dfdb-456b-a63c-dd5585886dcb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:06.294423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:06.295133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.295421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.295691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.296422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:06.297813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bade7-0d02-417c-a04d-6a8913b1fc5f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:06.318561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 496/1020] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:02:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:07.559768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a171f-ed05-4865-ae18-8b3c15a1caf0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:07.560304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a171f-ed05-4865-ae18-8b3c15a1caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:07.560304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a171f-ed05-4865-ae18-8b3c15a1caf0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:07.561756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 525/1021] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:07.566961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9371926-6547-4e16-8855-14767f668ffc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:07.567366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9371926-6547-4e16-8855-14767f668ffc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:07.567530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9371926-6547-4e16-8855-14767f668ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:07.584581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a9371926-6547-4e16-8855-14767f668ffc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:07.585773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a9371926-6547-4e16-8855-14767f668ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:07.656394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 497/1022] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:07.681168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a171f-ed05-4865-ae18-8b3c15a1caf0 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:07.780115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a171f-ed05-4865-ae18-8b3c15a1caf0 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:07.812011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:07.812747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:07.813027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:07.813296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:07.815125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:07.816543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827482-e30b-449f-814d-73055fa36cbd None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:07.822819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 526/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:07.823844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9371926-6547-4e16-8855-14767f668ffc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:07.919235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9371926-6547-4e16-8855-14767f668ffc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:07.954282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:07.955533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:07.955809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:07.956082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:07.956804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:07.958229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208d58-f671-497d-828c-77cde3cbf965 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:07.984688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 498/1024] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:02:07 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:08.326314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed837-3b1e-4dc9-af4d-9d9982c5d36f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.326673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed837-3b1e-4dc9-af4d-9d9982c5d36f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.326863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed837-3b1e-4dc9-af4d-9d9982c5d36f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.328274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 527/1025] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:08.333813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.334104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.334381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.350946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:08.352116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:08.421275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 499/1026] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:08.444829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ed837-3b1e-4dc9-af4d-9d9982c5d36f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.544828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ed837-3b1e-4dc9-af4d-9d9982c5d36f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:08.578307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:08.579037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.579366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.579630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] PATH_INFO: `/v3/services/image` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.580376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:08.581748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-71a0eecf-69cd-40b2-8cf7-6712acce462e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:08.593290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:08.594324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:08.595702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:08.600052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 528/1027] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:08.601463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.638532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925abc-0e7b-43c6-9442-15844bd3570d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.639102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925abc-0e7b-43c6-9442-15844bd3570d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.639560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925abc-0e7b-43c6-9442-15844bd3570d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.641218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 529/1028] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:08.647457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.647742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.648070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.665163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:08.666345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:08.700189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310f00c-149c-474d-9a83-31c41f31fe98 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:08.732905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 530/1029] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:08.734232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:08.735093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.735601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.736053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.737146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] RBAC: Adding query filter params (name=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:08.737629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:08.739169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:08.744301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 500/1030] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:08.749993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.757341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.851374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48d73-b95d-4a96-870b-67bb12bc4a29 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:08.854473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612623aa-c76a-43f6-a4d2-1dfdfb3cbd8e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:08.885323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:08.886107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.886384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.886650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.887352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] RBAC: Adding query filter params (type=image) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:08.887755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:08.889164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:08.889284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:08.890000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.890279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.890550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.896985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 531/1031] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:08.899844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.901369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:08.910223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:08.911177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:08.912025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 501/1032] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:08.916952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:08.999220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed398-31cc-4256-a74d-cca76b4f3f32 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.017282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44e58-2406-46d7-9264-b23406b78fa0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.033127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.033782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.034062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.034340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.035118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] RBAC: Adding query filter params (interface=public, service_id=150a3bee33fd4e5a8803be01bbc230f2, region_id=RegionOne) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:09.035426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.036787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.041648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 532/1033] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/endpoints?service_id=150a3bee33fd4e5a8803be01bbc230f2&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:09.049446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.054077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.054742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.055017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.055285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.056024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:09.056377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.057714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.068494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 502/1034] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:02:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:09.073745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.150444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3be12-b35a-4041-8670-75f64ca8c1ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.168551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0c644-f0c9-42f8-a52d-63bd6ddffdbe None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.185583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.186246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.186525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.186798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.187474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.189066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.195880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 533/1035] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:02:09.213143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.213975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.214257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.214528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.227861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.229386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:09.248385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:09.249427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:09.250408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:09.250408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:09.250408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:09.250408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:09.250769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 503/1036] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:09.256908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.359713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c14c8-1abe-4484-a70b-4bd515b8afbe None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.396439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.397175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.397450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.397718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.398490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:09.398788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.400198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.412296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 534/1037] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:09.417685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.512959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730505-97d3-45fb-bd7e-bfa51e43f849 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.544614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.545431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.545706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.545975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.553575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.554985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:02:09.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:09.570193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:09.571178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 504/1038] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:09.577551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.679436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2062d7-f5e2-440b-a837-159be7ba5765 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.717994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.718662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.718944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.719216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.720083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:09.720409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.721837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.739523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 535/1039] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:09.745340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.840957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097902-5a08-4d96-bee9-677e2ba71f62 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.872643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.873307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.873583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.873849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.938414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.940850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.040704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 505/1040] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:02:10.042473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.145136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142912b7-dc1c-42e8-8be9-f5f4727b719f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.179385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.180162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.180441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.180737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.190338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.191699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-23880f82-3355-4012-8987-c07731e03f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:10.208689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:10.209612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:10.210523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:10.210523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:10.210523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:10.210523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:10.211326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 536/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:10.215437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.289068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1fc4c-b4c4-426a-8d47-65dfd96e9b78 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.289354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1fc4c-b4c4-426a-8d47-65dfd96e9b78 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.289635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1fc4c-b4c4-426a-8d47-65dfd96e9b78 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.290988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 537/1042] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:10.295882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.296237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.296601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.311022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9915a-0494-4328-a1b0-d4bccd064b70 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.312752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:10.314509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:10.347315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.347986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.348267 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.348539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.349299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:10.349603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.350959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.367258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 506/1043] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:10.368395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.390642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 538/1044] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:10.414166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.465622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b57e-5a27-4b60-9b6b-23760ed27771 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.497948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.498735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.499011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.499280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.506655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.508075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.510475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c6e9-aea1-4c05-9310-3c91af7c2f04 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:02:10.522433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:10.523328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:10.524214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:10.528788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 507/1045] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:10.529580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.546244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.547038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.547320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.547597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.558367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:10.566845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:10.567814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:10.568789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:10.572962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 539/1046] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:10.573984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.625845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329601-72e9-4435-87df-8c1cbdfbe080 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.659067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.659720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.659996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.660262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.661078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:10.661376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.662792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.669458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ea45-5813-47c6-8366-e3eae2f3e995 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.674808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 508/1047] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:10.680392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.702881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.703522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.703711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.703984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.705364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:10.705667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.707015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.715113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 540/1048] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:10.720525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.777506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e935-5d7b-4ada-9b2b-8db353b24f00 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.809991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.810646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.810930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.811206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.812024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] RBAC: Adding query filter params (role.id=2e2f9a2486744c878550df3305017bab, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:10.812336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.814386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.816616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad554-378d-47f1-a323-1e80233bb86c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:10.828680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 509/1049] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=2e2f9a2486744c878550df3305017bab => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:10.858403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:10.859290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:10.859573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:10.859848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] PATH_INFO: `/v3/users/311403f4694840cab54380cd3b5c572b` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:10.875062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] RBAC: Authorizing `identity:get_user(user_id=311403f4694840cab54380cd3b5c572b)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:10.876734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:10.878548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 541/1050] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/users/311403f4694840cab54380cd3b5c572b => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:10.884423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:10.988627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ff80-35fc-44c5-b956-04cc6d41e60c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.023952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.024598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.024903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.025169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.089660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:11.091097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:11.185945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 510/1051] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:11.192187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.290665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3889153-fff2-4f0a-a00e-3068822c1d86 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.325285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.326146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.326423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.326694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.327858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:11.329911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a1e0-ea18-4799-b53a-f87ad7598728 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:11.331810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 542/1052] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:11.337515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.433080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724799-4f93-4eb5-bc52-bb0f7dd089db None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.455848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6024-c81b-4651-b4d9-c2e67ede2778 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.456137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6024-c81b-4651-b4d9-c2e67ede2778 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.456405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6024-c81b-4651-b4d9-c2e67ede2778 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.457961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 543/1053] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:11.462705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.462962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.463238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.465570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.466223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.466504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.466778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.467605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=e9a9177b6c7d431aa9601b090474d298, user.id=311403f4694840cab54380cd3b5c572b) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:11.467922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:11.469492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:11.480684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 511/1054] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/role_assignments?user.id=311403f4694840cab54380cd3b5c572b&scope.project.id=e9a9177b6c7d431aa9601b090474d298&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:11.480909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:11.480909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:11.553468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 544/1055] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:11.576219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.680797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842794-8f2d-4459-8d19-d9785208e6c9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.714756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.715548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.715827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.716097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.716831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:11.718209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:11.730661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:11.731641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:02:11.732569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:11.734063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 512/1056] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:11.738763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.836094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c1c4-9567-4ba1-8da9-ff516bd82140 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.869967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.870624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.870901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.871169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.872102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:11.872408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:11.873782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:11.878624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 545/1057] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:11.884200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.984639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206fe3-3955-44db-95be-cc447598b1e4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.018390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.019056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.019333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.019602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.020314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:12.020619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.021994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628aa8e-9f84-400f-bbcd-08520af91cc9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.027100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 513/1058] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:12.033817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.132209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba11a4-b678-468e-9f9b-818acaeaafb5 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.164715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.165367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.165642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.165907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.166638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.167985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003e815-e0a1-47c4-b92f-58b5e8e183de None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.186771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 546/1059] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:02:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:13.036838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363637-72f0-484b-808e-dd182582d251 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.037365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363637-72f0-484b-808e-dd182582d251 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.037365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363637-72f0-484b-808e-dd182582d251 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.038884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 514/1060] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:13.043863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.044267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.044431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.061783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:13.062942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:13.134549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 547/1061] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:13.156568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02363637-72f0-484b-808e-dd182582d251 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.252740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02363637-72f0-484b-808e-dd182582d251 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.285028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.285836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.286108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.286373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.296520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:13.305506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:13.306426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:13.307439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:13.308810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 515/1062] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:13.314744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.411301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c59b1a-4f95-40f6-810b-a508971458dd None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.443895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.444570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.444878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.445154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.445888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:13.446191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:13.447548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:13.456355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 548/1063] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:13.461896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.560296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62a90-f980-4843-a0c5-59326b4859e2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.592294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.593096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.593374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.593641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.603727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:13.605179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eaf7d1cf-8510-46c9-8aa3-39633113b73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:13.622203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:13.623087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:13.623994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:13.623994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:13.623994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:13.623994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:13.624803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 516/1064] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:13.629318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.704973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a532-e7d5-48d5-95b2-e6afa27908c8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.705318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a532-e7d5-48d5-95b2-e6afa27908c8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.705527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a532-e7d5-48d5-95b2-e6afa27908c8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.707043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 517/1065] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:13.711972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114770-a222-4210-904b-f6b08620e07c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.712259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114770-a222-4210-904b-f6b08620e07c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.712528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114770-a222-4210-904b-f6b08620e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.727727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759541-936e-4860-b3fe-14adad5cbfb5 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.729552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f6114770-a222-4210-904b-f6b08620e07c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:13.730717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f6114770-a222-4210-904b-f6b08620e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:13.762629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.763315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.763571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.763842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.764556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:13.764885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:13.766227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:13.778505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 549/1066] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:13.783934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.804702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 518/1067] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:13.826091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6114770-a222-4210-904b-f6b08620e07c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.879094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17e8f-a2c2-491f-9c02-5ab57c19691a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.915104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.915920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.916197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.916472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.923570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:13.925014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:13.927199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6114770-a222-4210-904b-f6b08620e07c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:02:13.939818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:13.941022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 550/1068] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:13.946922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:13.969982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:13.971016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:13.971297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:13.971573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:13.983010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:13.990677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:13.991842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:13.992746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 519/1069] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:13.999088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.050678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc0b73-38cf-49de-a929-c4a37436df1d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.085469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.086058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.086339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.086659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.087502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:14.087867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.089342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.102537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994f8-1397-4d65-a441-dc8e70c06ea3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.107692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 551/1070] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.114346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.135920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.136590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.136898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.137176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.137915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:14.138228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.139587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.148623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 520/1071] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.154456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.214685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add331b4-0d6b-4c00-947d-84b9118b5731 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.251668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8367-ec0b-49fe-9fbd-f97432ce5d3e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.256893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.257688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.257970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.258242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.273238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.275213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.287918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.288860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.289142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.289423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] PATH_INFO: `/v3/users/311403f4694840cab54380cd3b5c572b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.290697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] RBAC: Authorizing `identity:get_user(user_id=311403f4694840cab54380cd3b5c572b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.292158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.294112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 521/1072] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/users/311403f4694840cab54380cd3b5c572b => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:14.298723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:14.299721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:14.300691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:14.300691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:14.300691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:14.300691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:14.300929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.301005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 552/1073] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:14.305618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.403618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8335-7e39-4871-a61c-4c2f5036d353 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.417307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6a5f-2600-4c3d-a296-ed13eafb895b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.437304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.438156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.438582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.438921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.440112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.441610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.448092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 522/1074] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.449093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.452588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.453281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.453563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.453836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.455378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:14.455688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.457081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb200c-7933-4f8c-8727-359250688597 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.468536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 553/1075] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.470288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdee8e-393b-4a9e-8cf7-136af9378e8d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.470577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdee8e-393b-4a9e-8cf7-136af9378e8d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.470853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdee8e-393b-4a9e-8cf7-136af9378e8d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.472199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 554/1076] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:14.475073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdee8e-393b-4a9e-8cf7-136af9378e8d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.548907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7b8ff-2be0-46f1-9262-6bc45de65404 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.570077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdee8e-393b-4a9e-8cf7-136af9378e8d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.582374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.583251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.583530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.583801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298/users/311403f4694840cab54380cd3b5c572b/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.585838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a9177b6c7d431aa9601b090474d298, user_id=311403f4694840cab54380cd3b5c572b, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.587276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf1925-b659-4c5e-bf68-72533edc3f09 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.600705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 523/1077] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:02:14 2022] PUT /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298/users/311403f4694840cab54380cd3b5c572b/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:02:14.601991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.602275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.602548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.607413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.608243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.608526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.608833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.617356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.618812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.620481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:14.621736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:02:14.634558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:14.635559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:14.642601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 555/1078] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:14.643393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.694008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 524/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:14.716831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.754053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5bb15-e1c9-4dda-9ef3-58992e11adbc None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.794958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.796701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.796701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.796701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.796952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:14.797262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.799283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.811839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 556/1080] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.817611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:14.821365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd9364-a583-44eb-8a51-fe9df5627824 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.855395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.856453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.856780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.857113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.914907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c7607-6886-4734-94b5-bb8d1f5fb832 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:14.924055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.925539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.948275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:14.949115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.949399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.949675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/2e2f9a2486744c878550df3305017bab` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.951926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=a3fa3765319b4024ab300ae52161d649, role_id=2e2f9a2486744c878550df3305017bab)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:14.953386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:14.967096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 557/1081] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:02:14 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/a3fa3765319b4024ab300ae52161d649/roles/2e2f9a2486744c878550df3305017bab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:02:15.031812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 525/1082] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:02:15.038952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.148692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ab6e-5d74-48fb-8594-ab0aebc919e5 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.182160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.183323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.183828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.184318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.195219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.196970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-70dce378-4450-4364-8c78-37a0067e5055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:15.215489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:15.216406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:15.217371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:15.217371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:15.217371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:15.217371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:15.224497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 558/1083] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:15.226078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.324092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d666ee-6c84-4656-a0e6-0dc0778c2250 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.358274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.359270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.359735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.360804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.361719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:15.362207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.363783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308177a4-fb24-47ee-8946-a7188a4cfcc1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.375510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 526/1084] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:16.820075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f193ce-62a2-4ec9-837b-f4dec349992b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:16.820606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f193ce-62a2-4ec9-837b-f4dec349992b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:16.820606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f193ce-62a2-4ec9-837b-f4dec349992b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:16.822008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 559/1085] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:16.827384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:16.827771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:16.827932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:16.844781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:16.845987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:16.908270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 527/1086] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:16.931502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f193ce-62a2-4ec9-837b-f4dec349992b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.029932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f193ce-62a2-4ec9-837b-f4dec349992b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.068659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.069457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.069734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.070003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.080257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-9f9323dc-08b3-478a-8176-4e3548c88b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:17.087689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:17.088578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:17.089472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 560/1087] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:17.094803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.187528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc565-9f76-4466-b685-9f0c8ccd7dd3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.216408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f532e-1cb4-4001-8d0a-1322c106a6a5 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.216709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f532e-1cb4-4001-8d0a-1322c106a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.216986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f532e-1cb4-4001-8d0a-1322c106a6a5 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.218346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 561/1088] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:02:17.219815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.220471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.220780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.221053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.221796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:17.222098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.223453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.223569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.223762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.224035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.231547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 528/1089] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:17.237923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.241068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:17.242230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:17.304854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 562/1090] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:17.328535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.331564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86110-2bf8-49a6-ac83-cf7a75721de4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.363061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.364130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.364457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.364920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] PATH_INFO: `/v3/users/311403f4694840cab54380cd3b5c572b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.366202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] RBAC: Authorizing `identity:get_user(user_id=311403f4694840cab54380cd3b5c572b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.367805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.369462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 529/1091] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/users/311403f4694840cab54380cd3b5c572b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:17.374990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.419651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d999bdb-1075-40af-a964-6ec674c34225 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.451820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.452609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.452909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.453177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.462732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:17.467843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed57b7-f353-451b-a93d-ea591fcd3c04 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:17.470768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:17.471712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:02:17.472582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:17.473273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 563/1092] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:17.477885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.499711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.500351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.500676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.501462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.564730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.566170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.570543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c36aad-3218-4311-88c4-905038d83e66 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.601824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.602401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.602675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.602945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.603670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:17.603971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.605334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.613384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 564/1093] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:17.618894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.658881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 530/1094] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:02:17.664481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.710190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78a70-222e-4b9a-8630-b9c95810552c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.742480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.743261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.743537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.743807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.753827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.755230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:17.771411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:17.772317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:17.773260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:17.773260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:17.773260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:17.773260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:17.773260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 565/1095] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:17.773829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1e940-1f6a-4a8c-9e11-ea08e38be3de None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.778569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.808126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.809002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.809280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.809556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.810727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.812140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.814505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 531/1096] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:17.820430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.873093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85f9d-00f1-4d10-9e8d-f5025a848871 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.904609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.905282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.905565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.905840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.906547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:17.907420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.908836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.913320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeb3c-c8c9-4c31-89ec-f4e4abcaaf6b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:17.919963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 566/1097] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:17.925577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:17.945157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:17.945801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:17.946081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:17.946356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:17.947174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=e9a9177b6c7d431aa9601b090474d298, user.id=311403f4694840cab54380cd3b5c572b) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:17.947484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:17.948928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:17.968698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 532/1098] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/role_assignments?user.id=311403f4694840cab54380cd3b5c572b&scope.project.id=e9a9177b6c7d431aa9601b090474d298&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:18.023514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77efbc-3789-4fc4-8770-6a8a904dbf8e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.059414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.060227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.060502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.060801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.069006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.070464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:02:18.086093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:18.087245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:18.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 567/1099] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 10 03:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:18.093393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.190432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5ae9-51ae-4655-8dca-3041e455f997 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.222989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.223651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.223931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.224202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.225061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:18.225365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.226781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.243659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 533/1100] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:18.249503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.344329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318ea2e-3f5c-490d-ac6a-20360830c8ff None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.377378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.378024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.378303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.378578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.442515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.443949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.536187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 568/1101] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:18.541762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.635634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed79e9-ffba-4d3b-ab64-2f7020efbdb3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.667496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.668293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.668552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.668849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.679097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.680526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:18.697847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:18.698846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:18.699768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:02:18.699768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:18.699768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:02:18.699768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:18.699768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 534/1102] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:18.705145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.800600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd2ec6-4ee2-4171-8b4b-41d680893980 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.832663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.833333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.833611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.833882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.834592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:18.834894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.836249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.846879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 569/1103] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:18.852423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.945555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7c84-21b8-41d4-9d6f-f8b3b910af95 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.976803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.977522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.977799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.978072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.984319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.986451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:02:18.999535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:19.001406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:19.003065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 535/1104] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:02:19.006905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:19.106694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a15b-491c-49e6-8bc9-72f265dfd4ef None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:19.138491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:19.139141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:19.139419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:19.139688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:19.140459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:19.140799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:19.142430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717cce-3583-46b9-929e-0ad4aa4b6b84 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:19.154289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 570/1105] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:19.161116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:19.255400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88a27-b3a3-408e-ab35-7d644c3d02d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:19.286632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:19.287270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:19.287547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:19.287836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:19.288622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] RBAC: Adding query filter params (role.id=2e2f9a2486744c878550df3305017bab, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=a3fa3765319b4024ab300ae52161d649) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:19.288957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:19.290362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9e06a-e5bf-4ef2-9a88-a25e861f425a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:19.295879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 536/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:19 2022] GET /identity/v3/role_assignments?user.id=a3fa3765319b4024ab300ae52161d649&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=2e2f9a2486744c878550df3305017bab => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:20.198397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241b5e-3910-42b9-bd47-9a91ee5e5938 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:20.198911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241b5e-3910-42b9-bd47-9a91ee5e5938 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:20.198997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241b5e-3910-42b9-bd47-9a91ee5e5938 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:20.200305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 571/1107] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:20.205918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:20.206337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:20.206469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:20.223153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:20.224315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:20.286133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 537/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:20.310108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241b5e-3910-42b9-bd47-9a91ee5e5938 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:20.407897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241b5e-3910-42b9-bd47-9a91ee5e5938 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:20.439959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:20.440761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:20.441043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:20.441313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:20.442471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:20.443878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdecb6-5291-4ca6-a455-363e05fa49f0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:20.445508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 572/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:20.451166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:20.543524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102951a3-fed9-4a2e-9bf8-7b7dfdbd8d53 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:20.575424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:20.576072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:20.576354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:20.576629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:20.577378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:20.578844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c832-71e8-484c-ad2b-e5f2e3072d7d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:20.598332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 538/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:02:20 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:22.822058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41e92-1f89-4ba3-85e3-f41061612220 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:22.822639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41e92-1f89-4ba3-85e3-f41061612220 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:22.822639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41e92-1f89-4ba3-85e3-f41061612220 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:22.823972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 573/1111] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:22.829852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:22.830249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:22.830396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:22.847181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:22.848350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:22.911419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 539/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:22.934985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac41e92-1f89-4ba3-85e3-f41061612220 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:23.033726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac41e92-1f89-4ba3-85e3-f41061612220 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:23.066484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:23.067334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:23.067616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:23.067887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] PATH_INFO: `/v3/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:23.069370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] RBAC: Authorizing `identity:get_role(role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:23.070724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:23.072130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 574/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:22 2022] GET /identity/v3/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:23.077796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:23.171462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b545589-4dc8-41c6-8ce8-8fdf845be61d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:23.203753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:23.204750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:23.205027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:23.205293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] PATH_INFO: `/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:23.217472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] RBAC: Authorizing `identity:get_user(user_id=a238cfd9bd1b4336b6cb038bc97e4ea5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:23.218880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:23.220613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 540/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:23 2022] GET /identity/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:23.226476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:23.319483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739b81-ee9f-40e7-a0fc-158a905b4371 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:23.350445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:23.351016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:23.351295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:23.351565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:23.416047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:23.417497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:23.508065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 575/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:23.514005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:23.607268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cdcd0-ecea-4032-888d-dbde768eaf42 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:23.638671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:23.639509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:23.639784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:23.640053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:23.641882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:23.643294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83164123-f9f1-4cd4-ab7c-3252b363345b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:23.644982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 541/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:23 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:23.651010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:23.743321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea80e5-bbc7-4af2-8a32-310d9aafaf6c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:23.775461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:23.776100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:23.776383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:23.776679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:23.777753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=e9a9177b6c7d431aa9601b090474d298, user.id=a238cfd9bd1b4336b6cb038bc97e4ea5) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:23.778058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:23.779708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a36098-f081-41ec-988d-01c432814eaa None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:23.785206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 576/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:23 2022] GET /identity/v3/role_assignments?user.id=a238cfd9bd1b4336b6cb038bc97e4ea5&scope.project.id=e9a9177b6c7d431aa9601b090474d298&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:25.941306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6fad-e72a-4df0-8c91-81d8c043cd35 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:25.941863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6fad-e72a-4df0-8c91-81d8c043cd35 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:25.941863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6fad-e72a-4df0-8c91-81d8c043cd35 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:25.943198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 542/1118] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:25.948236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:25.948679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:25.948834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:25.965659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:25.966820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:26.029776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 577/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:26.051681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab6fad-e72a-4df0-8c91-81d8c043cd35 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:26.147827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab6fad-e72a-4df0-8c91-81d8c043cd35 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:26.179463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:26.180295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:26.180572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:26.180872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] PATH_INFO: `/v3/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:26.182318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] RBAC: Authorizing `identity:get_role(role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:26.183665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:26.185055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 543/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:26 2022] GET /identity/v3/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:26.191442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:26.283068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210a82e-3d53-4d45-be00-773636ba14c8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:26.315418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:26.316275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:26.316555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:26.316858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] PATH_INFO: `/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:26.318029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] RBAC: Authorizing `identity:get_user(user_id=a238cfd9bd1b4336b6cb038bc97e4ea5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:26.319434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:26.321052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 578/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:26 2022] GET /identity/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:26.326581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:26.419082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3bc3-4a5e-4d73-b074-a3abd8e6a2c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:26.450939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:26.451769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:26.452048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:26.452320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:26.453628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:26.455136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502664-fd2b-4959-96de-0fd39f26837a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:26.456811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 544/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:26 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:26.462524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:26.555697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24bcae-7b7a-429f-9572-c58082bc8f37 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:26.586804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:26.587661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:26.587940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:26.588212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298/users/a238cfd9bd1b4336b6cb038bc97e4ea5/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:26.590376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a9177b6c7d431aa9601b090474d298, user_id=a238cfd9bd1b4336b6cb038bc97e4ea5, role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:26.591782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c4b7-6cbe-4d3c-a2f3-0896bdedf3b9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:26.604470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 579/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:02:26 2022] PUT /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298/users/a238cfd9bd1b4336b6cb038bc97e4ea5/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:02:28.780449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011943e2-9738-47cb-ac56-5f2483386648 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:28.781036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011943e2-9738-47cb-ac56-5f2483386648 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:28.781036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011943e2-9738-47cb-ac56-5f2483386648 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:28.782896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 545/1124] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:28.788035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:28.788441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:28.788584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:28.805287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:28.806447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:28.869501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 580/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:28.892693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011943e2-9738-47cb-ac56-5f2483386648 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:28.988613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011943e2-9738-47cb-ac56-5f2483386648 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:29.020424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:29.021293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:29.021570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:29.021837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] PATH_INFO: `/v3/roles/794dd7a123b3413c96ed4c1ad920fecb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:29.023291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] RBAC: Authorizing `identity:get_role(role_id=794dd7a123b3413c96ed4c1ad920fecb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:29.024665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:29.026022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 546/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:28 2022] GET /identity/v3/roles/794dd7a123b3413c96ed4c1ad920fecb => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:29.032598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:29.126491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444bfd8-9edd-4300-a03d-b5c427bdf39c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:29.158289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:29.159137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:29.159415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:29.159689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] PATH_INFO: `/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:29.160873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a238cfd9bd1b4336b6cb038bc97e4ea5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:29.162298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:29.163892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 581/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:29 2022] GET /identity/v3/users/a238cfd9bd1b4336b6cb038bc97e4ea5 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:29.169549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:29.261077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3014f-7d28-42b0-b883-cb27414ac189 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:29.291977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:29.292539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:29.292841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:29.293112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:29.354302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:29.355714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:29.445880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 547/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:29.451624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:29.544807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b67-e37c-45e3-b2ce-2c36debb23b0 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:29.576248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:29.577110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:29.577390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:29.577660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] PATH_INFO: `/v3/projects/e9a9177b6c7d431aa9601b090474d298` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:29.578837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a9177b6c7d431aa9601b090474d298)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:29.580245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879353-889f-4612-ba79-661e0df01ff9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:29.581913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 582/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:29 2022] GET /identity/v3/projects/e9a9177b6c7d431aa9601b090474d298 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:29.587885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:29.679522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da119-7aed-41a2-9e16-6613eb570629 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:29.710656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:29.711288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:29.711556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:29.711831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:29.712638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] RBAC: Adding query filter params (role.id=794dd7a123b3413c96ed4c1ad920fecb, scope.project.id=e9a9177b6c7d431aa9601b090474d298, user.id=a238cfd9bd1b4336b6cb038bc97e4ea5) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:29.712969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:29.714372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828764f6-08a0-4cc0-9b1b-8ec2276a6b84 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:29.720629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 548/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:29 2022] GET /identity/v3/role_assignments?user.id=a238cfd9bd1b4336b6cb038bc97e4ea5&scope.project.id=e9a9177b6c7d431aa9601b090474d298&role.id=794dd7a123b3413c96ed4c1ad920fecb => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:31.919327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a59f7-91b2-4a38-a618-20b8a3377dff None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:31.919886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a59f7-91b2-4a38-a618-20b8a3377dff None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:31.919886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a59f7-91b2-4a38-a618-20b8a3377dff None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:31.921264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 583/1131] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:31.927339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade566-0c66-465b-8e77-920519b063bd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:31.927760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade566-0c66-465b-8e77-920519b063bd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:31.927900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade566-0c66-465b-8e77-920519b063bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:31.944242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8cade566-0c66-465b-8e77-920519b063bd None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:31.945459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8cade566-0c66-465b-8e77-920519b063bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:32.007457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 549/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:32.030938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a59f7-91b2-4a38-a618-20b8a3377dff None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:32.126961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a59f7-91b2-4a38-a618-20b8a3377dff None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:32.157701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:32.158459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:32.158730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:32.158995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:32.160138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:32.161565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9d5b-6f2b-42ab-8b20-0f2511027212 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:32.163133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 584/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:32.168881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cade566-0c66-465b-8e77-920519b063bd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:32.261261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cade566-0c66-465b-8e77-920519b063bd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:32.292301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:32.292958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:32.293237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:32.293505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:32.294198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:32.295610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cce9e1-2f3f-4da1-9c78-32c4caf59264 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:32.319746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 550/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:02:32 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:34.547329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b37ac-355c-4c5e-a168-adc553a17ed2 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:34.547877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b37ac-355c-4c5e-a168-adc553a17ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:34.547877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b37ac-355c-4c5e-a168-adc553a17ed2 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:34.549260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 585/1135] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:34.554463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:34.554882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:34.554998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:34.571772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:34.572972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:34.635572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 551/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:34.661078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b37ac-355c-4c5e-a168-adc553a17ed2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:34.756282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b37ac-355c-4c5e-a168-adc553a17ed2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:34.788802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:34.789577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:34.789855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:34.790125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:34.791282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:34.792713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a763f-13c1-41a3-b18b-40405b3542e7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:34.794335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 586/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:34.800047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:34.893606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9498-ad09-4a2a-8145-67b0568564e4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:34.926471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:34.927125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:34.927406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:34.927678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:34.928376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:34.929835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be9f5-0010-4aa4-96b7-9e2e7cf66b17 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:34.949385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 552/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:02:34 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:37.192529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3f121-16b3-4fd4-afaf-3687a831b5a0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.193070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3f121-16b3-4fd4-afaf-3687a831b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.193070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3f121-16b3-4fd4-afaf-3687a831b5a0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.194446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 587/1139] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:37.199669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.200095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.200195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.216896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:37.218049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:37.279602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 553/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:37.302500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3f121-16b3-4fd4-afaf-3687a831b5a0 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:37.396458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3f121-16b3-4fd4-afaf-3687a831b5a0 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:37.427502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:37.428255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.428531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.428830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.438879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:37.446346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:37.447526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:37.448636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:37.451362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 588/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:37.457443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:37.548962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fede5b7-1bab-44cd-b7dd-dcc34a70c1c0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:37.580209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:37.580868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.581147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.581414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.582145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:37.582442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:37.583781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:37.591239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 554/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:37.597169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:37.691055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73a9b-0e1f-47f7-b4ef-a51032603bf1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:37.722645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:37.723497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.723774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.724044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] PATH_INFO: `/v3/users/2404b949ce674648b710789a87eebe65` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.736500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] RBAC: Authorizing `identity:get_user(user_id=2404b949ce674648b710789a87eebe65)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:37.737966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:37.739584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 589/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:37 2022] GET /identity/v3/users/2404b949ce674648b710789a87eebe65 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:37.745325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:37.840634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e72f-aace-4107-bb99-b2d72e69486d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:37.871166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:37.871797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:37.872075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:37.872347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:37.934649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:37.936075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:38.027984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 555/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:38.033862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:38.126560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91655-963e-49cc-bbe0-8db623fd1036 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:38.159833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:38.160700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:38.160982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:38.161251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] PATH_INFO: `/v3/projects/337cdea695324fabb48658ad3137d164` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:38.162408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] RBAC: Authorizing `identity:get_project(project_id=337cdea695324fabb48658ad3137d164)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:38.163801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d320d-d529-468c-b765-b4b9acf833e9 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:38.165487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 590/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:38 2022] GET /identity/v3/projects/337cdea695324fabb48658ad3137d164 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:38.171636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:38.262421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c40b76-ec7e-4954-bd86-102f7fa1b1ea None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:38.294847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:38.295421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:38.295698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:38.296022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:38.296915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=337cdea695324fabb48658ad3137d164, user.id=2404b949ce674648b710789a87eebe65) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:38.297222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:38.298635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7aba-9613-472d-9159-b9884988d1d1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:38.303772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 556/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:38 2022] GET /identity/v3/role_assignments?user.id=2404b949ce674648b710789a87eebe65&scope.project.id=337cdea695324fabb48658ad3137d164&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:40.487241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e6df-5ce4-457f-8798-dbd4bc3618cc None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:40.487791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e6df-5ce4-457f-8798-dbd4bc3618cc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:40.487791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e6df-5ce4-457f-8798-dbd4bc3618cc None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:40.489190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 591/1147] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:40.494349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:40.494764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:40.494903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:40.511561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:40.512768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:40.575380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 557/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:40.597878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e6df-5ce4-457f-8798-dbd4bc3618cc None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:40.694352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e6df-5ce4-457f-8798-dbd4bc3618cc None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:40.725703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:40.726471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:40.726746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:40.727016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:40.736450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:40.744138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:40.745280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:40.746319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 592/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:40.752026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:40.843680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423add72-b0e5-4f1f-82f7-492aeb5b09d3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:40.874132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:40.875563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:40.875959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:40.876232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:40.876993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:40.877294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:40.878629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:40.886105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 558/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:40.892445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:40.984493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbe05-408f-410b-b91d-e4606cffeb63 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:41.015218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:41.016547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:41.016846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:41.017111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] PATH_INFO: `/v3/users/2404b949ce674648b710789a87eebe65` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:41.018266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] RBAC: Authorizing `identity:get_user(user_id=2404b949ce674648b710789a87eebe65)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:41.019667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:41.021273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 593/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:40 2022] GET /identity/v3/users/2404b949ce674648b710789a87eebe65 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:41.026854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:41.123365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032fdd6-f92e-4932-8262-920513f55d1a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:41.157477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:41.158329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:41.158608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:41.158877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] PATH_INFO: `/v3/projects/337cdea695324fabb48658ad3137d164` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:41.160051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] RBAC: Authorizing `identity:get_project(project_id=337cdea695324fabb48658ad3137d164)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:41.161505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9616070-f013-4847-a6a8-b873b9f92fcd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:41.163176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 559/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:41 2022] GET /identity/v3/projects/337cdea695324fabb48658ad3137d164 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:41.169114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:41.261894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833672-6cbd-4675-9e66-3e38fe577a10 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:41.293753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:41.294557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:41.294834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:41.295102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] PATH_INFO: `/v3/projects/337cdea695324fabb48658ad3137d164/users/2404b949ce674648b710789a87eebe65/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:41.297041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] RBAC: Authorizing `identity:create_grant(project_id=337cdea695324fabb48658ad3137d164, user_id=2404b949ce674648b710789a87eebe65, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:41.298443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260845e-0e74-49e2-b180-fa1e497b763a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:41.311180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 594/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:02:41 2022] PUT /identity/v3/projects/337cdea695324fabb48658ad3137d164/users/2404b949ce674648b710789a87eebe65/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:02:43.473330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498103d1-9f5d-4cff-b405-ec0ddaf1f8cc None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:43.473875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498103d1-9f5d-4cff-b405-ec0ddaf1f8cc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:43.473875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498103d1-9f5d-4cff-b405-ec0ddaf1f8cc None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:43.475226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 560/1154] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:43.480354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b23ea-4647-4224-946f-032df80de82d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:43.480812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b23ea-4647-4224-946f-032df80de82d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:43.480912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b23ea-4647-4224-946f-032df80de82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:43.497677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-152b23ea-4647-4224-946f-032df80de82d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:43.498841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-152b23ea-4647-4224-946f-032df80de82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:43.562336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 595/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:43.585488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498103d1-9f5d-4cff-b405-ec0ddaf1f8cc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:43.680296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498103d1-9f5d-4cff-b405-ec0ddaf1f8cc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:43.711213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:43.711979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:43.712255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:43.712524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:43.722945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:43.730438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:43.731539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:43.732439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 561/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:43.737577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b23ea-4647-4224-946f-032df80de82d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:43.829462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b23ea-4647-4224-946f-032df80de82d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:43.860290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:43.860963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:43.861241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:43.861510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:43.862235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:43.862535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:43.863877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:43.871378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 596/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:02:43.877720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:43.971787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f39c65-3823-4c8d-81ae-24e31b3c1301 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:44.003195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:44.003985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:44.004261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:44.004529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] PATH_INFO: `/v3/users/2404b949ce674648b710789a87eebe65` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:44.005724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] RBAC: Authorizing `identity:get_user(user_id=2404b949ce674648b710789a87eebe65)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:44.007140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:44.008911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 562/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:43 2022] GET /identity/v3/users/2404b949ce674648b710789a87eebe65 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:44.014307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:44.108807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871629-b80e-48ca-b764-dc9c129f1da2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:44.140691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:44.141323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:44.141601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:44.141871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:44.204873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:44.206299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:44.297927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 597/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:44.303963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:44.396175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53123c-4e2b-4098-a071-93b0fee6f916 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:44.427884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:44.428742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:44.429023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:44.429296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] PATH_INFO: `/v3/projects/337cdea695324fabb48658ad3137d164` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:44.430448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] RBAC: Authorizing `identity:get_project(project_id=337cdea695324fabb48658ad3137d164)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:44.431857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcdce2-a915-46ea-85eb-b347a6b12840 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:44.433536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 563/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:44 2022] GET /identity/v3/projects/337cdea695324fabb48658ad3137d164 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:44.439589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:44.532586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942aaae-69ef-43fb-bc8b-06c9899920ac None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:44.564193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:44.564806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:44.565082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:44.565354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:44.566162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=337cdea695324fabb48658ad3137d164, user.id=2404b949ce674648b710789a87eebe65) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:44.566470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:44.567863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492990-21bb-4cfe-ada2-9846ce4330df None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:44.573367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 598/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:44 2022] GET /identity/v3/role_assignments?user.id=2404b949ce674648b710789a87eebe65&scope.project.id=337cdea695324fabb48658ad3137d164&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:46.792937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef752-f1fe-46c4-8cc1-24a3e03641f3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:46.793493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef752-f1fe-46c4-8cc1-24a3e03641f3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:46.793493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef752-f1fe-46c4-8cc1-24a3e03641f3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:46.794857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 564/1162] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:46.800760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:46.801210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:46.801314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:46.817941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:46.819121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:46.880801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 599/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:46.903681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef752-f1fe-46c4-8cc1-24a3e03641f3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:46.997975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef752-f1fe-46c4-8cc1-24a3e03641f3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:47.029911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:47.030541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:47.031358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:47.031706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:47.094888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:47.096330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:47.188135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 565/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:47.194088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:47.285242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c416-4c00-4ab2-b475-654b7f8e7c67 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:47.316887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:47.317612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:47.317892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:47.318164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:47.324460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:47.325905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-ee21b02c-eb11-45b6-8e2b-bcfe94547588 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:47.340086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:47.341255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:02:47.342321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 600/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:02:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:47.347652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:47.439246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1b46-d068-470c-a8de-16b09ad61c1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:47.471416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:47.472060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:47.472341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:47.472616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:47.473359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:47.473663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:47.475017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2b2f-050f-4f56-bb79-245560ed3043 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:47.481829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 566/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 10 03:02:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:49.646964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a7ff-a170-4b3d-8c49-98bed9544b2d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:49.647495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a7ff-a170-4b3d-8c49-98bed9544b2d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:49.647495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088a7ff-a170-4b3d-8c49-98bed9544b2d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:49.648924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 601/1167] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:49.654565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8739c-975d-435d-b716-2471b47df4ca None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:49.654984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8739c-975d-435d-b716-2471b47df4ca None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:49.655115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8739c-975d-435d-b716-2471b47df4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:49.671621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f5c8739c-975d-435d-b716-2471b47df4ca None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:49.672813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f5c8739c-975d-435d-b716-2471b47df4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:49.735280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 567/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:49.758393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088a7ff-a170-4b3d-8c49-98bed9544b2d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:49.854652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088a7ff-a170-4b3d-8c49-98bed9544b2d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:49.887458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:49.888098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:49.888379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:49.888674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:49.889428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:49.891040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275334db-7a9d-4171-8209-5c605f0a01d0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:49.906825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 602/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Tue May 10 03:02:49 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:52.159091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1a488-be6d-4616-b993-7c928e7b36c5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:52.159638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1a488-be6d-4616-b993-7c928e7b36c5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:52.159638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1a488-be6d-4616-b993-7c928e7b36c5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:52.161031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 568/1170] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:52.166323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:52.166721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:52.166868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:52.183067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:52.184231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:52.245905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 603/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:02:52.269999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1a488-be6d-4616-b993-7c928e7b36c5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:52.366034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1a488-be6d-4616-b993-7c928e7b36c5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:52.397412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:52.398253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:52.398530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:52.398801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] PATH_INFO: `/v3/domains/62348da91a4640f4a97f701502eee012` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:52.408760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=62348da91a4640f4a97f701502eee012)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:52.410186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4eaa3-c7bd-4dcd-ae4e-e26640199523 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:52.411781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 569/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 10 03:02:52 2022] GET /identity/v3/domains/62348da91a4640f4a97f701502eee012 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:52.417465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:52.508681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5b893-b38a-495f-a391-920efb59c856 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:52.539815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:52.540451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:52.540753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:52.541026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:52.541709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:52.543094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4022d1-afcc-4e6b-993a-a05c3b3f1b25 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:52.568080 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 604/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:02:52 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:54.807885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7620a0-9677-44f1-a325-8a5724fa9143 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:54.808449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7620a0-9677-44f1-a325-8a5724fa9143 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:54.808449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7620a0-9677-44f1-a325-8a5724fa9143 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:54.809906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 570/1174] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:54.815595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:54.816043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:54.816144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:54.838582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:54.839764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:54.923126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 605/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:54.952618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7620a0-9677-44f1-a325-8a5724fa9143 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:55.076853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7620a0-9677-44f1-a325-8a5724fa9143 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:55.114585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:55.115448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:55.115726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:55.115994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] PATH_INFO: `/v3/domains/62348da91a4640f4a97f701502eee012` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:55.117203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] RBAC: Authorizing `identity:get_domain(domain_id=62348da91a4640f4a97f701502eee012)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:55.119254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dc633-7690-470e-94bf-8a3b60b1620e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:55.121751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 571/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 10 03:02:54 2022] GET /identity/v3/domains/62348da91a4640f4a97f701502eee012 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:55.128070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:55.222065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb52380-81e2-4676-b08b-7fd7a61e0b72 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:55.259375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:55.260040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:55.260314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:55.260580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:55.261313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:55.262716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939a6c8-3dd2-473e-8ae3-f54a54555260 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:55.283293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 606/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:02:55 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:57.547934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe028a-50db-41b7-9372-4869738f7f88 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:57.548488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe028a-50db-41b7-9372-4869738f7f88 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:57.548488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe028a-50db-41b7-9372-4869738f7f88 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:57.549878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 572/1178] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:57.555027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:57.555397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:57.555573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:57.572270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:57.573454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:57.641350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 607/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:57.664477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe028a-50db-41b7-9372-4869738f7f88 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:57.759639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe028a-50db-41b7-9372-4869738f7f88 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:57.790278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:57.791049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:57.791325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:57.791593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:57.802042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:57.809476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:57.810634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:02:57.811924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 573/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:57.817036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:57.910153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf240a-5868-43ff-9c7e-54197637fcf8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:57.942714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:57.943358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:57.943633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:57.943898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:57.944621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:57.944948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:57.946288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:57.954013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 608/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:57.959690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:58.053265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902417-d77b-44eb-9533-bb116987aa97 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:58.085611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:58.086465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:58.086738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:58.087004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] PATH_INFO: `/v3/users/8ebd79a785834208bf5e18839928e26c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:58.099225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebd79a785834208bf5e18839928e26c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:58.100637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:58.102289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 574/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:02:57 2022] GET /identity/v3/users/8ebd79a785834208bf5e18839928e26c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:58.107978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:58.200912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c3dd4-4e16-40f4-bd8c-d36286bec484 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:58.231787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:58.232409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:58.232706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:58.232975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:58.295257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:58.296860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:58.387924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 609/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:02:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:58.393707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:58.486511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e942-69d2-4b03-83c8-02ebdd4aef40 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:58.518974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:58.519804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:58.520077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:58.520344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] PATH_INFO: `/v3/projects/d2ce1f433d274f289031df953b0423ab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:58.521523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ce1f433d274f289031df953b0423ab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:58.522932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4d4ea-e95f-41ae-a563-11e247ac4226 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:58.524577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 575/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:02:58 2022] GET /identity/v3/projects/d2ce1f433d274f289031df953b0423ab => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:58.530762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:58.622067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ecc44-8303-4e6b-9a58-ef6fa4a8c198 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:58.653738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:58.654307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:58.654581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:58.654849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:58.655714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=d2ce1f433d274f289031df953b0423ab, user.id=8ebd79a785834208bf5e18839928e26c) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:58.656018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:58.657450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bbd3a-d1d5-4635-a7e6-5e896b159c74 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:58.662569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 610/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:02:58 2022] GET /identity/v3/role_assignments?user.id=8ebd79a785834208bf5e18839928e26c&scope.project.id=d2ce1f433d274f289031df953b0423ab&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:00.820834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2addb-d7c2-41ab-82ef-c698860cc1ca None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:00.821363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2addb-d7c2-41ab-82ef-c698860cc1ca None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:00.821363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2addb-d7c2-41ab-82ef-c698860cc1ca None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:00.822720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 576/1186] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:00.827853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:00.828274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:00.828497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:00.844576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:00.845773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:00.907348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 611/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:03:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:00.929568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2addb-d7c2-41ab-82ef-c698860cc1ca None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:01.024578 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2addb-d7c2-41ab-82ef-c698860cc1ca None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:01.057018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:01.057800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:01.058080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:01.058350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:01.068208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:01.075852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:01.077025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:03:01.078143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 577/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:01.083024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:01.177353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377c7f4-3493-4932-973a-8b2138157a91 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:01.209090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:01.209745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:01.210027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:01.210300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:01.211034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:01.211338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:01.212726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:01.221390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 612/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:01.227036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:01.320393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1a82b-04cc-4068-9af2-d5299a02b504 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:01.351398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:01.352192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:01.352467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:01.352761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] PATH_INFO: `/v3/users/8ebd79a785834208bf5e18839928e26c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:01.353923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebd79a785834208bf5e18839928e26c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:01.355332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:01.356951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 578/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:03:01 2022] GET /identity/v3/users/8ebd79a785834208bf5e18839928e26c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:01.363301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:01.459412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9ce0-38b6-4bc1-ad12-50184c7070f1 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:01.490440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:01.491273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:01.491546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:01.491816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] PATH_INFO: `/v3/projects/d2ce1f433d274f289031df953b0423ab` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:01.492986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ce1f433d274f289031df953b0423ab)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:01.494397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc006f-7ec8-4316-9475-d81a86990312 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:01.496035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 613/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:03:01 2022] GET /identity/v3/projects/d2ce1f433d274f289031df953b0423ab => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:01.502013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:01.595486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693177-a340-4c24-9233-17c0419d4fc6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:01.627469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:01.628280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:01.628556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:01.628858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] PATH_INFO: `/v3/projects/d2ce1f433d274f289031df953b0423ab/users/8ebd79a785834208bf5e18839928e26c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:01.630762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce1f433d274f289031df953b0423ab, user_id=8ebd79a785834208bf5e18839928e26c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:01.632169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a945-be10-408b-84de-cb0f4701f490 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:01.644226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 579/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:03:01 2022] PUT /identity/v3/projects/d2ce1f433d274f289031df953b0423ab/users/8ebd79a785834208bf5e18839928e26c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:03:03.835456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102aa5-2302-4c88-879f-77ca3b8206fe None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:03.836016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102aa5-2302-4c88-879f-77ca3b8206fe None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:03.836016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102aa5-2302-4c88-879f-77ca3b8206fe None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:03.837510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 614/1193] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:03.843184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:03.843590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:03.843728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:03.860005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:03.861195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:03.922963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 580/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:03.954240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8102aa5-2302-4c88-879f-77ca3b8206fe None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.048776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8102aa5-2302-4c88-879f-77ca3b8206fe None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.080914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.081686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.081965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.082235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.091707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:04.099183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:04.100246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:03:04.101179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 615/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:04.106310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.198052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84ed85-ab23-4cd9-b706-2ebb2c6a8e4f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.229531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.230176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.230454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.230728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.231462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:04.231763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:04.235269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:04.240992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 581/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:04.246727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.339818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace027a-8d8d-48ba-8f10-1094abaeda02 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.371193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.371976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.372256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.372525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] PATH_INFO: `/v3/users/8ebd79a785834208bf5e18839928e26c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.374262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebd79a785834208bf5e18839928e26c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:04.375647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:04.377661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 616/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 10 03:03:04 2022] GET /identity/v3/users/8ebd79a785834208bf5e18839928e26c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:04.382879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.476013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ea245-6452-49d0-9559-9c7a65f93872 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.507721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.508346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.508623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.508924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.571111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:04.572536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:04.663117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 582/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:03:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:03:04.668906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.761599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4685e-1aa2-4a88-abc0-562ce9735f11 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.792713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.793549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.793825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.794096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] PATH_INFO: `/v3/projects/d2ce1f433d274f289031df953b0423ab` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.795234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d2ce1f433d274f289031df953b0423ab)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:04.796874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64e6b-1c16-4496-9f34-87ab21a937e0 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:04.798521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 617/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 10 03:03:04 2022] GET /identity/v3/projects/d2ce1f433d274f289031df953b0423ab => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:04.804454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:04.896922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f1a72-4a2a-4ed9-9c05-eefa7079a897 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:04.929239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:04.929821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:04.930100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:04.930371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:04.931183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=d2ce1f433d274f289031df953b0423ab, user.id=8ebd79a785834208bf5e18839928e26c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:04.931489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:04.932912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34fe14-46a5-4ead-8f68-9e169552b16d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:04.938484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 583/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:03:04 2022] GET /identity/v3/role_assignments?user.id=8ebd79a785834208bf5e18839928e26c&scope.project.id=d2ce1f433d274f289031df953b0423ab&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:05.504073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71929-56fd-4dd6-9d6c-f5dbc4efffab None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:05.504814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71929-56fd-4dd6-9d6c-f5dbc4efffab None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:05.504814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71929-56fd-4dd6-9d6c-f5dbc4efffab None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:05.506028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 618/1201] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:05.513174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:05.513697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:05.513918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:05.534907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:05.536471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:05.628802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 584/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:05.663114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71929-56fd-4dd6-9d6c-f5dbc4efffab None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:05.787282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71929-56fd-4dd6-9d6c-f5dbc4efffab None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:05.826643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:05.827832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:05.828476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:05.828971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:05.841558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:05.843226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:05.864962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:05.866183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:05.867272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:05.867272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:05.867272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:05.867272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:05.867272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 619/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:05.874219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:05.991771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1add0-a84b-4abf-9a52-7d20127bffd4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:06.030717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:06.031437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:06.031743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:06.032015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:06.032779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:06.033082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:06.034446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a095c-dee6-453e-90c3-e98281c8c4b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:06.047620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 585/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:06.054894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:06.177628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f390-b94b-4bee-9b54-ffd931a21997 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:06.218264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:06.218986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:06.219332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:06.219663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:06.220576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:06.222620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17381f-3723-4a99-bcca-cbd02e6dba4d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:06.253241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 620/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 10 03:04:06 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:04:08.715261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa277f-34a5-47f3-a435-cbb1220275a6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.715838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa277f-34a5-47f3-a435-cbb1220275a6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.715838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa277f-34a5-47f3-a435-cbb1220275a6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.717219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 586/1206] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:08.722510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.722951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.723059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.740292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:08.741503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:08.810698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 621/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:08.835638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa277f-34a5-47f3-a435-cbb1220275a6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:08.947639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa277f-34a5-47f3-a435-cbb1220275a6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:08.985108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:08.986264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.986593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.986878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.999097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:09.007016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:09.008131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:09.009032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 587/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:09.015112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.129867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd9cf-03f8-4bf7-8778-a0eec168369f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.170574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.171462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.171862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.172271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.173222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:09.173563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.175027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.187238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 622/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:09.193671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.310045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134515-f8ca-4f82-aee4-75dafc2f6c91 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.348919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.349725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.350003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.350270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.361189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.362763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:09.381645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:09.382827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:09.383878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:09.383878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:09.383878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:09.383878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:09.383878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 588/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:09.389820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.498761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377152d-6af6-4760-926e-e0d3ad06db8e None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.540584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.541333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.541602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.541922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.543657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:09.543984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.545705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.559261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 623/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:04:09.564883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.684422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b67609-c9b2-4df8-a2fc-9db8304bdcfc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.724460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.728188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.728475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.728781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.737607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.739544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:09.757391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:09.758612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:09.759601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 589/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:09.768220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.882732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4c2e-a4b9-484e-bcf1-f7b3f12253ee None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.921648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.922325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.922642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.922933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.923801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:09.924108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.925583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.944519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 624/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:09.952677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:10.069940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe95e-0089-4066-9eb0-0ff749913574 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:10.107264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:10.108717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:10.109004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:10.109277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:10.179762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:10.181351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:10.296713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 590/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:04:10.302542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:10.407479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320544-3aba-426b-a5f4-088b5420b75d None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:10.447064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:10.447856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:10.448140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:10.448468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:10.459041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:10.460817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:10.480298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:10.481501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:10.482633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:10.482633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:10.482633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:10.482633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:10.488472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 625/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:10.489623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:10.595375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d6a20-691b-4625-846e-4d89f5507a16 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:10.630934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:10.631596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:10.631870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:10.632178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:10.632896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:10.633203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:10.634577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:10.647658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 591/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:10.654387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:10.759993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e908c6-98fb-4364-912b-3cd96acb4d67 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:10.796025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:10.796890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:10.797175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:10.797460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:10.805225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:10.806753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:10.822658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:10.824588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:10.825562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 626/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:10.830534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:10.938115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61407d8-767b-4954-8f34-2f88fd2be456 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:10.976637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:10.977327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:10.977611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:10.977886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:10.978672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:10.978978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:10.981037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2123ae-64d9-4f1f-a2f5-282ee8a8c4ad None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:10.996833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 592/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:11.000327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:11.109734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422726e-2f99-4951-8769-39e0b5eb2a54 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:11.146855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:11.147730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.148013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.148285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.152682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=614c1bd3422341358ed13584bfb24439) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:11.152682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:11.152682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7dfe-4b01-4fc8-b761-a6c7d74b7e4e None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:11.157977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 627/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:04:10 2022] GET /identity/v3/role_assignments?user.id=614c1bd3422341358ed13584bfb24439&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:13.533574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3521dd-ef4d-4308-a58a-3225d9fa61ee None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:13.534119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3521dd-ef4d-4308-a58a-3225d9fa61ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:13.534119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3521dd-ef4d-4308-a58a-3225d9fa61ee None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:13.535502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 593/1220] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:13.541015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:13.541478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:13.541693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:13.560383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:13.561607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:13.632729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 628/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:13.655470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3521dd-ef4d-4308-a58a-3225d9fa61ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:13.762251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3521dd-ef4d-4308-a58a-3225d9fa61ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:13.796144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:13.796889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:13.797170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:13.797443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:13.807470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:13.815937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:13.817202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:13.818145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 594/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:04:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:13.824676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:13.932292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb8681-7ee0-457a-804f-08b49f8462c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:13.975502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:13.976188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:13.976464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:13.976761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:13.977518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] RBAC: Adding query filter params (name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:13.977820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:13.979209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:13.988764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 629/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:04:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:13.994900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.110528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66044732-7377-4a4e-b49f-26e1ef6d7523 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:14.143193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:14.143979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:14.144257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:14.144525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:14.155152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:14.156581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:14.174154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:14.175311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:14.176329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:14.176329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:14.176329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:14.176329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:14.176329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 595/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:14.181532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.283304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a672c68-a003-4b48-92ab-3898263be07f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:14.320102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:14.320722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:14.321134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:14.321406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:14.322130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:14.322488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:14.323903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:14.336173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 630/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:14.342529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.455044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082773-3abe-4a19-b243-12c14397b443 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:14.489952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:14.490810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:14.491124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:14.491398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:14.499920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:14.501393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:14.516366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:14.517414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:14.518619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 596/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:14.524308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.628905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90511602-1acb-4022-b8bb-59ae3dd3610c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:14.665410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:14.666097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:14.666377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:14.666654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:14.668690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:14.669008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:14.670444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:14.688602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 631/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:14.694411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.797359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1d225-e4cf-42d0-a2b3-935647bbe846 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:14.833107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:14.833948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:14.834237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:14.834514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:14.846864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:14.848298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:14.869638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:14.871322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:14.872412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:14.872412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:14.872412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:14.872412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:14.872412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 597/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:14.878295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:14.992739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c2362-b6ce-4582-ab57-febc866ae11c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:15.027266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:15.027989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:15.028269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:15.028583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:15.029373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:15.029713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:15.031159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:15.043975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 632/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:15.051090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:15.152301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789cf2-f95a-4a03-a5ab-4c5107aa781b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:15.187342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:15.188136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:15.188420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:15.188718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:15.195575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:15.197053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:15.212115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:15.213092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:15.215175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 598/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:15.219745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:15.320057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2878e-86c2-4bae-ace0-ce475315eff7 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:15.355612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:15.356267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:15.356551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:15.356928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:15.357635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:15.357934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:15.359358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3356c-1960-4399-83e1-a08e652f2e6f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:15.372479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 633/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:15.378605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:15.486828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d300d4-bc98-4d78-9f98-8b088134e2a7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:15.520720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:15.521640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:15.521886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:15.522283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/614c1bd3422341358ed13584bfb24439/roles/9bd78a97e57f4c4fbce691aae2842d73` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:15.538833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=614c1bd3422341358ed13584bfb24439, role_id=9bd78a97e57f4c4fbce691aae2842d73)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:15.541350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350a294-3b89-47ff-9155-3eaf4e5ff1cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:15.556003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 599/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:04:15 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/614c1bd3422341358ed13584bfb24439/roles/9bd78a97e57f4c4fbce691aae2842d73 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:04:17.879423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd73f-c932-41f2-9bb9-e5558bc6e11c None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:17.879972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd73f-c932-41f2-9bb9-e5558bc6e11c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:17.879972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd73f-c932-41f2-9bb9-e5558bc6e11c None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:17.881372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 634/1233] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:17.887774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:17.888243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:17.888522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:17.905842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:17.907087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:17.977753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 600/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:18.002101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacd73f-c932-41f2-9bb9-e5558bc6e11c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:18.103637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacd73f-c932-41f2-9bb9-e5558bc6e11c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:18.141320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:18.142028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:18.142302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:18.142569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:18.153871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:18.162472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:18.163616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:04:18.164681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:18.166515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 635/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:04:18.173356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:18.274909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdfce2-4bd4-4b3b-a8a2-6b0ceedc05e4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:18.309870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:18.310535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:18.310814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:18.311085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:18.311850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:18.312148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:18.313556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:18.323620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 601/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:18.333458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:18.455403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33528-c6fd-4707-b5ec-03facc11c92f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:18.491853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:18.492635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:18.492935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:18.493202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:18.505820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:18.507471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:18.525337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:18.526992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:18.528047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:18.528047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:18.528047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:18.528047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:18.528047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 636/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:18.532782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:18.645585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6ade3-29bd-4365-a143-c73fc1a91a45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:18.683313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:18.684140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:18.684423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:18.684727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:18.685699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:18.686434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:18.688283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:18.703283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 602/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:18.708968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:18.828575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c4a-92df-4aa6-9177-6fa30c603d38 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:18.864793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:18.865591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:18.865866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:18.866133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:18.874944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:18.876520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:18.891610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:18.893248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:18.894477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:18.896806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 637/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:18.898566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:19.010935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27326d3-e8d9-4673-a435-f58d30ed8392 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:19.050104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:19.050781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:19.051231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:19.051347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:19.052167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:19.052470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:19.053938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:19.072482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 603/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:19.078989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:19.186889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269406af-faa6-45f5-b35d-5934d78e6c2a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:19.221785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:19.222683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:19.223051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:19.223431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:19.299744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:19.301134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:19.426335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 638/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:04:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:04:19.433202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:19.536526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9933ba-6c6b-4d7d-ac71-f0852da91c8f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:19.574463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:19.575140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:19.575418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:19.575692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:19.585886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:19.587354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:19.606650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:19.607852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:19.609135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:19.609135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:19.609135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:19.609135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:19.609135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 604/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:19.613865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:19.724643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274086d0-dda8-4870-839e-8fbc7af7893c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:19.762619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:19.763382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:19.763732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:19.764007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:19.764870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:19.765179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:19.766750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:19.780066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 639/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:19.785558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:19.906608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae51d-f418-40b9-a952-a0abe922bbf6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:19.949727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:19.950585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:19.950863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:19.951132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:19.959727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:19.961770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:19.977193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:19.978452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:19.980513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 605/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:19.985368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:20.090092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab080-ff9f-4f06-ad3a-c968361da53f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:20.128240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:20.128930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:20.129207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:20.129481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:20.130253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:20.130556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:20.132157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a7ccb-c229-44f0-9c9f-51ccc1d48c70 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:20.147163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 640/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:20.154715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:20.271140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847386-8fc7-4799-97fe-e598bacd4041 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:20.306983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:20.307738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:20.308013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:20.308303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:20.309315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] RBAC: Adding query filter params (role.id=9bd78a97e57f4c4fbce691aae2842d73, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=614c1bd3422341358ed13584bfb24439) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:20.309720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:20.311442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718bcc-27a3-4cf2-8dc3-d2fd7e80ee1a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:20.317422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 606/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:04:20 2022] GET /identity/v3/role_assignments?user.id=614c1bd3422341358ed13584bfb24439&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=9bd78a97e57f4c4fbce691aae2842d73 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:22.715976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fbbb-2482-432a-b71c-d2feb26dfaf0 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:22.716532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fbbb-2482-432a-b71c-d2feb26dfaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:22.716532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fbbb-2482-432a-b71c-d2feb26dfaf0 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:22.717935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 641/1247] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:22.723685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f25c2-0d71-4c26-8813-881458955010 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:22.724197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f25c2-0d71-4c26-8813-881458955010 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:22.724318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f25c2-0d71-4c26-8813-881458955010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:22.743230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-189f25c2-0d71-4c26-8813-881458955010 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:22.744420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-189f25c2-0d71-4c26-8813-881458955010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:22.817854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 607/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:22.843929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839fbbb-2482-432a-b71c-d2feb26dfaf0 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:22.955844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839fbbb-2482-432a-b71c-d2feb26dfaf0 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:22.992180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:22.992927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:22.993218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:22.993521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.005098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:23.013786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:23.014821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:23.015671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 642/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:04:23.021392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f25c2-0d71-4c26-8813-881458955010 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.132270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f25c2-0d71-4c26-8813-881458955010 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:23.171405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:23.172070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:23.172350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:23.172619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.173397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:23.173701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:23.175054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:23.183440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 608/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:23.189743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.293452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686632a7-c4df-4452-84ea-8ceac19c6dc2 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:23.330676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:23.331522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:23.331825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:23.332128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.346149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:23.346343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:23.364508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:23.365819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:23.366722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:23.366722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:23.366722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:23.366722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:23.366722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 643/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:23.373929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.483223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430c66-3e7e-4b1a-8d73-b3b6f951af08 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:23.518310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:23.518996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:23.519273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:23.519543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.520287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:23.520585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:23.521955 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:23.540554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 609/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:23.542420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.654150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d92c9-fe52-4e4b-a7dd-a2cd81b9d305 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:23.688780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:23.689572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:23.689852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:23.690149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.698304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:23.699801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:23.714217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:23.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:23.716932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 644/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:23.721629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.826379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1b82-d833-4b3a-815a-3b774c68b61c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:23.865052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:23.865852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:23.866169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:23.866508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:23.867618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:23.867923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:23.869511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:23.891319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 610/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:23.896996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:23.999262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdcd6f-2841-446a-a8b4-09847b002d3b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:24.035357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:24.036004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:24.036283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:24.036553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:24.108584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:24.110369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:24.219379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 645/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:04:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:04:24.225707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:24.336920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9981-9617-4495-9ba0-96f507c51ebd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:24.375953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:24.376790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:24.377062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:24.377325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:24.388953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:24.390434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:24.413035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:24.414319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:24.415701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:24.415701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:24.415701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:24.415701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:24.415701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 611/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:24.421104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:24.535181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086c8d-e15e-4408-8db2-c9458ffdf420 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:24.570880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:24.571547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:24.571821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:24.572087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:24.573560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:24.573916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:24.575301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:24.587474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 646/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:24.593150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:24.695366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e0875-d6f4-4126-ad76-2b2ac6eeb66e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:24.730979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:24.731788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:24.732064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:24.732335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:24.739581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:24.741072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:24.755823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:24.757039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:24.758076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 612/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:24.763793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:24.864461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789b519-db4d-4058-a458-edc6c893d185 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:24.896736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:24.897396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:24.897676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:24.897948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:24.898723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:24.899029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:24.900448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0df7d-5bbc-4098-8f70-12f0bb70094b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:24.913063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 647/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:24.919029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:25.018501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274e0e-05d7-4dcc-a271-0f3b53262f6f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:25.051993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:25.052662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:25.052961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:25.053226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:25.054051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=614c1bd3422341358ed13584bfb24439) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:25.054361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:25.055774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddf36a-f4e1-4245-8d13-bc51b3d7d587 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:25.062437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 613/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:04:24 2022] GET /identity/v3/role_assignments?user.id=614c1bd3422341358ed13584bfb24439&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:27.234866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08897-cda5-4d94-bfb0-3f2d71152997 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.235419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08897-cda5-4d94-bfb0-3f2d71152997 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.235419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08897-cda5-4d94-bfb0-3f2d71152997 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.236811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 648/1261] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:27.241859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.242293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.242402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.259035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:27.260844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:27.331416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 614/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:27.353124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08897-cda5-4d94-bfb0-3f2d71152997 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:27.465014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08897-cda5-4d94-bfb0-3f2d71152997 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:27.498025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:27.498799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.499076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.499345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.508846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:27.516433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:27.517534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:27.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 649/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:27.523585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:27.620738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c0515-82a9-446e-a2cd-395d9d1b686b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:27.654090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:27.654746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.655026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.655297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.656033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:27.656337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:27.657731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:27.665358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 615/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:27.671061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:27.763700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123d3d-404d-4ddf-a869-02748eb80758 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:27.794944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881789b-0089-4e68-b328-6db902341464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:27.795702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881789b-0089-4e68-b328-6db902341464 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.795979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881789b-0089-4e68-b328-6db902341464 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.796250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881789b-0089-4e68-b328-6db902341464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.806098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881789b-0089-4e68-b328-6db902341464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:27.807686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881789b-0089-4e68-b328-6db902341464 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-b881789b-0089-4e68-b328-6db902341464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:27.824233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:27.825266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:27.826340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:27.826340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:27.826340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:27.826340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:27.826340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 650/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:27.830919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:27.939598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f001f0-8f30-495b-8cfa-866ca84f4fe0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:27.971562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:27.972234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:27.972514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:27.972815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:27.973524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:27.973851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:27.975218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:27.986206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 616/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:27.991822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881789b-0089-4e68-b328-6db902341464 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.085131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881789b-0089-4e68-b328-6db902341464 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.115801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.116582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.116884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.117154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.124664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.126084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:28.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:28.141386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:28.142553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 651/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:28.147086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.240623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78260211-01ab-4de1-9090-4ff282c19d43 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.277386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.278039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.278317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.278585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.279408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:28.279710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.281227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.297278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 617/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:28.302847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.396442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602271e-8b2f-4323-8a91-c584633a14f3 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.430823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.431604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.432501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.432937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.449839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.451261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:28.467500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:28.468559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:28.469715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:28.469715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:28.469715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:28.469715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:28.469715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 652/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:28.474367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.570392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b5dba-09bd-40d6-b3c8-c271fa555bd5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.601372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.602015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.602295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.602566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.603273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:28.603576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.605582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.616074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 618/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:28.622187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.714921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63d51-5663-4ae8-b33e-2efb08996034 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.745876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.746633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.746910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.747176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.753411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.754820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:28.769032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:28.770085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:28.771241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 653/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:28.776270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:28.868581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbff0-8f05-4604-a1f1-1b64dcdab26c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:28.900276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:28.901312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:28.901589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:28.901860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:28.902637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:28.902943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:28.904359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da098aee-9820-4e26-8b3d-edacfa5b2ab7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:28.915576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 619/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:28.921301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:29.013962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8d78-bd1b-448e-85ef-36eabafbe89c None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:29.045160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:29.046016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:29.046290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:29.046559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] PATH_INFO: `/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/614c1bd3422341358ed13584bfb24439/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:29.048478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] RBAC: Authorizing `identity:create_grant(project_id=8886c28b19cf4953b82e5b20ad4b6b46, user_id=614c1bd3422341358ed13584bfb24439, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:29.050953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b724f-b31d-468d-95e1-bc5e4603eedf None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:29.065039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 654/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 10 03:04:28 2022] PUT /identity/v3/projects/8886c28b19cf4953b82e5b20ad4b6b46/users/614c1bd3422341358ed13584bfb24439/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:04:31.256597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eff1-b38d-4cba-82a0-0c101d7dd909 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.257177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eff1-b38d-4cba-82a0-0c101d7dd909 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.257177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7eff1-b38d-4cba-82a0-0c101d7dd909 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.258532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 620/1274] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:31.263863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.264284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.264403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.281002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:31.282161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:31.344129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 655/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:31.367337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7eff1-b38d-4cba-82a0-0c101d7dd909 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:31.467253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7eff1-b38d-4cba-82a0-0c101d7dd909 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:31.498205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:31.498975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.499250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.499517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.508922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:04:31.516910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:31.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:31.519056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 621/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 10 03:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:31.524015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:31.614982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca2f4a-6672-43bf-bff6-aed73fa97a89 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:31.645916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:31.646557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.646833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.647101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.647821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:31.648116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:31.649474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:31.658026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 656/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 10 03:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:31.663625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:31.758079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489edc77-5b27-49c4-b470-876f845f1b9d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:31.789127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:31.789899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.790177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.790448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.800610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:31.802069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:31.818631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:31.819685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:31.820610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:31.820610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:31.820610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:31.820610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:31.820610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 622/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:04:31.826256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:31.918500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644253bd-ae2d-427c-ac5d-a19240e88e0a None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:31.950103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:31.950749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:31.951032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:31.951307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:31.952021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:31.952326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:31.953700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:31.964661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 657/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:31.970167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.063849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b0a1-a68b-4883-b4eb-3d1557605e3b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:32.095863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:32.096676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:32.096958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:32.097228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:32.104963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:32.106381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:04:32.120947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:32.122140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:32.123106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 623/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:32.127776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.219135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b23b-bce8-4ecb-960a-14a7cefb3105 None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:32.250804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:32.251443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:32.251718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:32.251986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:32.252823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:32.253125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:32.254529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:32.271243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 658/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 10 03:04:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:32.277409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.369832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b6fc-a690-4cdf-9be5-6c81e4960ea8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:32.403559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:32.404235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:32.404507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:32.404810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:32.472544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:32.473922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:32.564399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 624/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 10 03:04:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:04:32.570185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.662282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e287d-428c-4fd4-b11b-7aa2acd2b4de None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:32.693703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:32.694468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:32.694746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:32.695016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:32.704787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:32.706215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:32.723915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:32.724976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:32.730270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:32.730270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:32.730270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:32.730270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:32.730270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 659/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:32.731427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.824070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc334-4b59-44fb-9334-bdb0f320646b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:32.856132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:32.856858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:32.857136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:32.857412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:32.858138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:32.858436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:32.859784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:32.871186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 625/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 10 03:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:32.876689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:32.969380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2faa59-0d5f-4eaf-bed5-65eda6cdeb9b None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:33.001528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:33.002238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:33.002518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:33.002788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:33.009072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:33.010510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:33.023684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application with Lock( May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:33.024717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: ERROR keystone.server.flask.application May 10 03:04:33.025931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 660/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 10 03:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:33.031111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:33.127633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3581-fa17-4bf2-8390-8acff220d787 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:33.159403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:33.160050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:33.160332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:33.160602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:33.161406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:33.161713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:33.163133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119257cf-d1c1-4b40-83dd-8b2c992e9a38 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:33.175388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 626/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 10 03:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:33.181394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:33.274232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcebda-367d-4ff8-ad71-00b1371158df None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:33.304514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:33.305166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:33.305444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:33.305713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:33.306513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] RBAC: Adding query filter params (role.id=93fe7bb88abd486bad9f0a4bb804fe11, scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46, user.id=614c1bd3422341358ed13584bfb24439) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:33.307448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:33.309010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8d32-93e7-4e56-bd7e-18dd570c8b09 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:33.314443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 661/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 10 03:04:33 2022] GET /identity/v3/role_assignments?user.id=614c1bd3422341358ed13584bfb24439&scope.project.id=8886c28b19cf4953b82e5b20ad4b6b46&role.id=93fe7bb88abd486bad9f0a4bb804fe11 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:35.541831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212d61-35b3-4d1d-9492-4331572075f0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:35.542379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212d61-35b3-4d1d-9492-4331572075f0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:35.542379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e212d61-35b3-4d1d-9492-4331572075f0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:35.543717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 627/1288] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:35.550417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:35.550829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:35.550965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:35.569665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:35.570916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:35.637163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 662/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:35.659287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e212d61-35b3-4d1d-9492-4331572075f0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:35.752766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e212d61-35b3-4d1d-9492-4331572075f0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:35.784102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:35.784898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:35.785176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:35.785443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:35.786078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:35.787415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:35.798811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:35.799988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:35.801242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 628/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:04:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:35.809003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:35.901449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97159c-48b6-48cc-b990-8574a9365ea2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:35.933844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:35.934579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:35.934862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:35.935133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:35.935826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:35.936128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:35.937521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f389a7b-324f-4939-86a8-c80c9c842362 None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:35.942112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 663/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 10 03:04:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:35.947716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:36.039069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8b7f-72ab-45e6-9c9a-4e3fdce9e270 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:36.071264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:36.071911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:36.072282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:36.072639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:36.073359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:36.073659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:36.075000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58671-4cf9-4779-aafb-881f3c0e9624 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:36.079182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 629/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 10 03:04:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:38.264293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b359-febe-4e3e-9bb9-85b5b77b2a5e None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:38.264851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b359-febe-4e3e-9bb9-85b5b77b2a5e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:38.264851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273b359-febe-4e3e-9bb9-85b5b77b2a5e None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:38.266227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 664/1293] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:38.271555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e238c-1d55-4a47-a811-fac35098dd51 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:38.271964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e238c-1d55-4a47-a811-fac35098dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:38.272108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e238c-1d55-4a47-a811-fac35098dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:38.289258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-327e238c-1d55-4a47-a811-fac35098dd51 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:38.290426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-327e238c-1d55-4a47-a811-fac35098dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:38.352004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 630/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:38.374056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273b359-febe-4e3e-9bb9-85b5b77b2a5e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:38.486259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273b359-febe-4e3e-9bb9-85b5b77b2a5e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:38.527959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:38.528608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:38.528918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:38.529186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:38.529894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:38.531244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeb7e2-fb51-4d9f-90db-25b80689bd3d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:38.543214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 665/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 10 03:04:38 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:04:40.747222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c96d3d-dde6-4188-83ad-9d2526065af3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:40.747752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c96d3d-dde6-4188-83ad-9d2526065af3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:40.747752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c96d3d-dde6-4188-83ad-9d2526065af3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:40.749195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 631/1296] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:40.754430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:40.754830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:40.754984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:40.771572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:40.772775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:40.841104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 666/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:40.863125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c96d3d-dde6-4188-83ad-9d2526065af3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:40.958958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c96d3d-dde6-4188-83ad-9d2526065af3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:40.990111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:40.990877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:40.991151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:40.991416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:40.992047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:40.993427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:41.005244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:41.006375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:41.007398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 632/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:04:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:41.012815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:41.105526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68358252-267c-456a-bff5-e5a1921accb3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:41.137112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:41.137765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:41.138048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:41.138325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:41.139024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:41.139331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:41.140698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:41.146984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 667/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 10 03:04:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:41.153139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:41.246783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8a958-c127-4b4d-b90a-5e4da9eb3d10 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:41.277637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:41.278217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:41.278497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:41.278771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:41.279543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] RBAC: Adding query filter params (interface=public, service_id=3afb68ef86fd44129f2ce2be62a7ec6a, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:41.279848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:41.281249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d252ce-66f3-48fb-b11a-a8230135e045 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:41.285986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 633/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 10 03:04:41 2022] GET /identity/v3/endpoints?service_id=3afb68ef86fd44129f2ce2be62a7ec6a&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:41.292015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:41.385345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e687-3916-48fc-8c12-06b312ce184f None admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:41.425392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:41.426172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:41.426651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:41.427140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:41.427972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:41.429855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645912-4105-4401-ac7c-251e440d262d None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:41.438712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 668/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 10 03:04:41 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:04:43.628853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4534-81cb-401e-9e08-cbd5452a03c3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:43.629459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4534-81cb-401e-9e08-cbd5452a03c3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:43.629459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4534-81cb-401e-9e08-cbd5452a03c3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:43.630766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 634/1302] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:43.636350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:43.636785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:43.636935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:43.653908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:43.655064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:43.717143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 669/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:04:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:43.739121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4534-81cb-401e-9e08-cbd5452a03c3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:43.835305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4534-81cb-401e-9e08-cbd5452a03c3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:43.865800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:43.866597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:43.866874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:43.867139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:43.867773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:43.869658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:43.881253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:43.882425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 10 03:04:43.883537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 635/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 10 03:04:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:43.889418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:43.983810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab875b17-b10b-47c9-8e30-83fe4e19d6c2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:44.016645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:44.017323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:44.017608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:44.017882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] PATH_INFO: `/v3/services` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:44.018578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:44.018884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:44.020237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee89897-eed8-4530-b420-73d1783f841c None admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:44.025807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 670/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 10 03:04:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:44.031381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:44.125475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4245-aa39-46b0-ae8d-00b28c748398 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:44.156504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:44.157119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:44.157403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:44.157674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:44.158403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:44.159745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ab00f-f317-4499-8dd3-972c8a869aa8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:44.177953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 636/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 10 03:04:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:05:47.555475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d27c-582f-4b0e-aeae-d550e8bedd2b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:47.556029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d27c-582f-4b0e-aeae-d550e8bedd2b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:47.556029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d27c-582f-4b0e-aeae-d550e8bedd2b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:47.558105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 671/1307] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:47.566349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370548f2-6310-4a7c-a221-5ef237936817 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:47.566861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370548f2-6310-4a7c-a221-5ef237936817 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:47.566861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370548f2-6310-4a7c-a221-5ef237936817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:47.723613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-370548f2-6310-4a7c-a221-5ef237936817 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:47.724848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-370548f2-6310-4a7c-a221-5ef237936817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:47.868064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 637/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:47.928784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:47.929065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:47.929316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:47.930904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 672/1309] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 10 03:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:47.937903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66725-86e7-41c5-9692-06450404f467 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:47.938200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66725-86e7-41c5-9692-06450404f467 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:47.938583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66725-86e7-41c5-9692-06450404f467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:48.040811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cca66725-86e7-41c5-9692-06450404f467 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:48.042216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cca66725-86e7-41c5-9692-06450404f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:48.160951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:05:48.162731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:48.167514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 638/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 10 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:48.319918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e9406-ffe0-4568-ab36-dc8029bf6965 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:05:48.401146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:05:48.402074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:48.402958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:48.403386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:48.405467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:48.520132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:05:48.521579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6850cb-3e9f-4eee-b061-8407340e46e8 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:05:48.542028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 673/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:05:51.146021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:51.146545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:51.146642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:51.147957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 639/1312] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:51.153931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905130a-f030-4947-be60-00031940ba66 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:51.154379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905130a-f030-4947-be60-00031940ba66 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:51.154469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905130a-f030-4947-be60-00031940ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:51.235421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e905130a-f030-4947-be60-00031940ba66 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:51.236537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e905130a-f030-4947-be60-00031940ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:51.330941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 674/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:51.369344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:05:51.370790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:51.472860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9074f4-5083-42e3-acaa-070a1773da6b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:05:51.545365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:05:51.545936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:51.546215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:51.546484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:51.548104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:51.655720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:05:51.657193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2005d82-7dc7-470e-bd6b-507ae70a77f6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:05:51.676034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 640/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:05:54.222988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:54.223546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:54.223546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:54.224936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 675/1315] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:54.230640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0c80c-4db2-45e4-834c-28962a2b7918 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:54.231031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0c80c-4db2-45e4-834c-28962a2b7918 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:54.231209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0c80c-4db2-45e4-834c-28962a2b7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:54.292733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9cb0c80c-4db2-45e4-834c-28962a2b7918 None None] MFA Rules not processed for user `7bbedd417be842a191a1377eebc6eb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:54.293922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9cb0c80c-4db2-45e4-834c-28962a2b7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:54.385050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 641/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:54.428015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:05:54.429617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:54.530130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a706-0dd5-4698-a31f-4d61c239b178 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:05:54.602220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:05:54.602878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:54.603309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:54.603714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:54.605549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:54.711823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:05:54.713672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ccc0-660b-433a-b13e-419c954b2e97 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:05:54.730797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 676/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:05:57.482913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed51e-32d1-4ce5-aa5f-d2194add3da4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:57.483498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed51e-32d1-4ce5-aa5f-d2194add3da4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:57.483498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed51e-32d1-4ce5-aa5f-d2194add3da4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:57.484898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 642/1318] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:57.490130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664740f-1ffb-447b-8e82-6c3cccc8f6cc None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:57.490537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664740f-1ffb-447b-8e82-6c3cccc8f6cc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:57.490684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664740f-1ffb-447b-8e82-6c3cccc8f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:57.552549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1664740f-1ffb-447b-8e82-6c3cccc8f6cc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:57.553770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1664740f-1ffb-447b-8e82-6c3cccc8f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:57.645198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 677/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:05:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:57.697621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:57.697621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:57.698246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:57.699619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 643/1320] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 10 03:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:05:57.705465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8167ad-bbad-4ad9-a4b5-7c2b62d067d0 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:57.705752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8167ad-bbad-4ad9-a4b5-7c2b62d067d0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:57.706025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8167ad-bbad-4ad9-a4b5-7c2b62d067d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:57.779126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0c8167ad-bbad-4ad9-a4b5-7c2b62d067d0 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:05:57.780242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0c8167ad-bbad-4ad9-a4b5-7c2b62d067d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:57.850664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 678/1321] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 10 03:05:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:05:57.860232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:05:57.861791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:57.959195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93d431-e0d6-4d72-8c9c-9ac6dc3159d2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:05:58.028509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:05:58.029215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:05:58.029444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:05:58.029713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:05:58.031317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:05:58.135244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:05:58.136683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259d05b-6419-4b79-8681-509d1b611b0e service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:05:58.154522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 644/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:01.590150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:01.590716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:01.590716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:01.592075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 679/1323] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:01.597563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c0ddd-3b85-4827-aee3-c4b086566421 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:01.597985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c0ddd-3b85-4827-aee3-c4b086566421 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:01.598231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c0ddd-3b85-4827-aee3-c4b086566421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:01.661686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-420c0ddd-3b85-4827-aee3-c4b086566421 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:01.662879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-420c0ddd-3b85-4827-aee3-c4b086566421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:01.757087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 645/1324] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:01.794955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:01.796468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:01.898821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0aa89-98a2-40d4-8aa2-969bc9f6d11f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:01.970144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:01.970791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:01.971070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:01.971340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:01.972975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:02.078164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:02.079601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3d7c-46e7-4b73-a7cd-c626dda314ca service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:02.097812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 680/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:04.364996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:04.365524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:04.365524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:04.366881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 646/1326] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:04.373494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38506b0-0df1-4790-b628-9a4e6a393d2f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:04.373973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38506b0-0df1-4790-b628-9a4e6a393d2f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:04.374098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38506b0-0df1-4790-b628-9a4e6a393d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:04.436145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-a38506b0-0df1-4790-b628-9a4e6a393d2f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:04.437339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a38506b0-0df1-4790-b628-9a4e6a393d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:04.532163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 681/1327] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:04.567324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:04.568888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:04.670033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c0f5-4a4c-4f54-84a5-166c0e79dd8a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:04.741477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:04.742124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:04.742410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:04.742687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:04.744919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:04.849954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:04.851389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ada4f1-f6af-45b4-aa73-bd064fbcd260 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:04.869802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 647/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:07.179507 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:07.180040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:07.180040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:07.182656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 682/1329] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:07.188105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2f7b-f719-44b1-bda4-865755509c7c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:07.188526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2f7b-f719-44b1-bda4-865755509c7c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:07.188706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2f7b-f719-44b1-bda4-865755509c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:07.251869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-367a2f7b-f719-44b1-bda4-865755509c7c None None] MFA Rules not processed for user `7bbedd417be842a191a1377eebc6eb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:07.253079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-367a2f7b-f719-44b1-bda4-865755509c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:07.346663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 648/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:07.383241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:07.385495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:07.484759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdc7f1-85c0-4dc5-89e4-cb232c47e294 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:07.554950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:07.555593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:07.555867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:07.556191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:07.557881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:07.660750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:07.662101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5ae9-b096-43c6-aeea-a86a52cf8a7e service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:07.680368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 683/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:10.147289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:10.147792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:10.147887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:10.149336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 649/1332] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:10.156047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ff57-1876-4989-bb27-34f845370993 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:10.156540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ff57-1876-4989-bb27-34f845370993 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:10.156635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ff57-1876-4989-bb27-34f845370993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:10.224499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d735ff57-1876-4989-bb27-34f845370993 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:10.225721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d735ff57-1876-4989-bb27-34f845370993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:10.317049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 684/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:10.353108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:10.354667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:10.455757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df9af-bbe9-4e1e-ac73-3e8f132f5510 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:10.527695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:10.528586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:10.528892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:10.529161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:10.530777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:10.634103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:10.635738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a23f7-64fb-4a13-846b-64e6779b2d95 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:10.654263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 650/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:12.929411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:12.929911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:12.930028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:12.931359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 685/1335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:12.936905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd937a-c014-4798-9059-7fda37b729e2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:12.937335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd937a-c014-4798-9059-7fda37b729e2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:12.937443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd937a-c014-4798-9059-7fda37b729e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:13.000827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f7fd937a-c014-4798-9059-7fda37b729e2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:13.002027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f7fd937a-c014-4798-9059-7fda37b729e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:13.104911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 651/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:13.152034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:13.153939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:13.251927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda7324-e87e-4a33-8ba6-460dd49b9af7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:13.322233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:13.322866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:13.323141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:13.323407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:13.325039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:13.427838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:13.429481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e05d-4e40-4335-9934-fb8ed16a820c service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:13.446730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 686/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:16.072355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:16.072885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:16.072996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:16.074374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 652/1338] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:16.079613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb7c1-b9b8-414a-950b-a23f30ce3fa6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:16.080007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb7c1-b9b8-414a-950b-a23f30ce3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:16.080161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb7c1-b9b8-414a-950b-a23f30ce3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:16.142467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-409cb7c1-b9b8-414a-950b-a23f30ce3fa6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:16.143641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-409cb7c1-b9b8-414a-950b-a23f30ce3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:16.235661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 687/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:16.270983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:16.272476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:16.373829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eca5c7-ca49-42c5-9530-943e055015b0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:16.444376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:16.445063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:16.445346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:16.445617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:16.447835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:16.551316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:16.552763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11506a-9fd5-4306-a7a5-a61b0db9f3f3 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:16.570380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 653/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:20.802446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:20.802951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:20.802951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:20.804272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 688/1341] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:20.809657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5c98-e82d-4e01-a637-7f78c98a8dbe None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:20.810072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5c98-e82d-4e01-a637-7f78c98a8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:20.810205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5c98-e82d-4e01-a637-7f78c98a8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:20.877483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-956b5c98-e82d-4e01-a637-7f78c98a8dbe None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:20.878713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-956b5c98-e82d-4e01-a637-7f78c98a8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:20.978672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 654/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:21.017481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:21.019671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:21.118822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecdcf1-b9c7-41d0-9358-c7b6aff4b5ed None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:21.122460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:21.123112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:21.123390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:21.123662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:21.132559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:21.134052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be801-e252-4f0f-ba64-516f2a081a53 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:21.143624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 689/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:24.399395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80dab-9ed9-4f93-98aa-c6a31fb6aa88 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:24.400018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80dab-9ed9-4f93-98aa-c6a31fb6aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:24.400018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80dab-9ed9-4f93-98aa-c6a31fb6aa88 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:24.401352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 655/1344] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:24.407666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900aac6-1d69-493b-8629-611ca873d9a7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:24.408133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900aac6-1d69-493b-8629-611ca873d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:24.408215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900aac6-1d69-493b-8629-611ca873d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:24.437825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0900aac6-1d69-493b-8629-611ca873d9a7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:24.439043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0900aac6-1d69-493b-8629-611ca873d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:24.514899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 690/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:24.551472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80dab-9ed9-4f93-98aa-c6a31fb6aa88 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:24.563174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80dab-9ed9-4f93-98aa-c6a31fb6aa88 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:24.566732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:24.567438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:24.567789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:24.568131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:24.577505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:24.578923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242014b-77a4-4dd5-8ba2-bbecdc2d84e2 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:24.589731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 656/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:28.955316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdf22-5c06-4bdf-a86d-14d1b63979f2 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:28.955848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdf22-5c06-4bdf-a86d-14d1b63979f2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:28.955848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdf22-5c06-4bdf-a86d-14d1b63979f2 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:28.957284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 691/1347] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:28.963231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63accf-5275-4b67-a229-e4f3aff17981 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:28.963659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63accf-5275-4b67-a229-e4f3aff17981 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:28.963901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63accf-5275-4b67-a229-e4f3aff17981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:28.980898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f63accf-5275-4b67-a229-e4f3aff17981 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:28.982058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f63accf-5275-4b67-a229-e4f3aff17981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:28.989689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 657/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:29.027342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcdf22-5c06-4bdf-a86d-14d1b63979f2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:29.037904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcdf22-5c06-4bdf-a86d-14d1b63979f2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:29.041573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:29.042203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:29.042482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:29.042754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:29.051956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:29.053513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3f4ae-9906-4ffb-bf91-5678c4ae2fc7 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:29.063035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 692/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:34.439072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa5f-c92f-422a-abc1-6dfe807e2a96 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:34.439609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa5f-c92f-422a-abc1-6dfe807e2a96 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:34.439609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ffa5f-c92f-422a-abc1-6dfe807e2a96 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:34.441320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 658/1350] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:34.446148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b50c-e3c7-4ba9-80d0-899423fea435 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:34.447246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b50c-e3c7-4ba9-80d0-899423fea435 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:34.447502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b50c-e3c7-4ba9-80d0-899423fea435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:34.519414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2ba1b50c-e3c7-4ba9-80d0-899423fea435 None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:34.520627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2ba1b50c-e3c7-4ba9-80d0-899423fea435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:34.605961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 693/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:06:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:39.050866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c22-3800-4201-a2aa-507b983fe5aa None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:39.051428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c22-3800-4201-a2aa-507b983fe5aa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:39.051428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1c22-3800-4201-a2aa-507b983fe5aa None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:39.053161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 659/1352] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:39.058898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048555ae-3fa2-46f4-8fb9-e2d2351a7a7e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:39.059435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048555ae-3fa2-46f4-8fb9-e2d2351a7a7e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:39.059435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048555ae-3fa2-46f4-8fb9-e2d2351a7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:39.077425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-048555ae-3fa2-46f4-8fb9-e2d2351a7a7e None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:39.078598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-048555ae-3fa2-46f4-8fb9-e2d2351a7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:39.088809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 694/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:06:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:40.622940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b171b9-25f3-4f87-9afa-625932612b0b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:40.623474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b171b9-25f3-4f87-9afa-625932612b0b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:40.623474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b171b9-25f3-4f87-9afa-625932612b0b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:40.624862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 660/1354] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:40.629708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5537-719f-4be6-a717-d3c4f6d97f0b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:40.630159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5537-719f-4be6-a717-d3c4f6d97f0b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:40.630373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5537-719f-4be6-a717-d3c4f6d97f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:40.648447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1e9a5537-719f-4be6-a717-d3c4f6d97f0b None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:40.650214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1e9a5537-719f-4be6-a717-d3c4f6d97f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:40.659013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 695/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:06:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:44.382200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b239-b4a3-4ee7-b701-594ed79483f0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:44.382801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b239-b4a3-4ee7-b701-594ed79483f0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:44.382801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b239-b4a3-4ee7-b701-594ed79483f0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:44.384342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 661/1356] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:44.389569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9ad7-8ea6-40a3-86c3-55312e1bc127 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:44.389977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9ad7-8ea6-40a3-86c3-55312e1bc127 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:44.390125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9ad7-8ea6-40a3-86c3-55312e1bc127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:44.408404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d30e9ad7-8ea6-40a3-86c3-55312e1bc127 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:44.409802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d30e9ad7-8ea6-40a3-86c3-55312e1bc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:44.418333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 696/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:06:44.466188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9725f6-d57a-42eb-b911-cad5cb8729c3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:44.466491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9725f6-d57a-42eb-b911-cad5cb8729c3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:44.466753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9725f6-d57a-42eb-b911-cad5cb8729c3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:44.468222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 662/1358] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 10 03:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:06:44.473502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e1cf-7952-4bc5-b1ca-04da0889974d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:44.473921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e1cf-7952-4bc5-b1ca-04da0889974d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:44.474294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e1cf-7952-4bc5-b1ca-04da0889974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:44.522037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9fd5e1cf-7952-4bc5-b1ca-04da0889974d None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:44.523199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fd5e1cf-7952-4bc5-b1ca-04da0889974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:44.603713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 697/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 10 03:06:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:06:44.611368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9725f6-d57a-42eb-b911-cad5cb8729c3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:44.626281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9725f6-d57a-42eb-b911-cad5cb8729c3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:44.631708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:44.632530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:44.632883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:44.633256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:44.642388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:44.644252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6a5a9-1f5a-4255-ac67-16f4e42ea6fb service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:44.655348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 663/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:47.150116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b76c8-986c-4c15-b274-9b4c86eaf8d7 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:47.150666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b76c8-986c-4c15-b274-9b4c86eaf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:47.150666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b76c8-986c-4c15-b274-9b4c86eaf8d7 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:47.156812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 698/1361] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:47.158056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cc92-1d28-4d5e-ad18-be7e338a97cc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:47.158519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cc92-1d28-4d5e-ad18-be7e338a97cc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:47.158604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cc92-1d28-4d5e-ad18-be7e338a97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:47.176374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3730cc92-1d28-4d5e-ad18-be7e338a97cc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:47.177803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3730cc92-1d28-4d5e-ad18-be7e338a97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:47.185740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 664/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:06:47.231078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b76c8-986c-4c15-b274-9b4c86eaf8d7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:47.245221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b76c8-986c-4c15-b274-9b4c86eaf8d7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:47.250611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:47.251253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:47.251536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:47.251810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:47.260111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:47.261727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49a72-4121-4c4e-87ea-227954bfd0e8 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:47.271050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 699/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:49.821394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5d3e-d0b3-4861-85c0-8400251de6e0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:49.822092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5d3e-d0b3-4861-85c0-8400251de6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:49.822198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5d3e-d0b3-4861-85c0-8400251de6e0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:49.823593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 665/1364] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:49.828859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7116-a7d0-4997-97a0-9dbabe0236d8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:49.829261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7116-a7d0-4997-97a0-9dbabe0236d8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:49.829421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7116-a7d0-4997-97a0-9dbabe0236d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:49.858659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-969b7116-a7d0-4997-97a0-9dbabe0236d8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:49.860356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-969b7116-a7d0-4997-97a0-9dbabe0236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:49.876350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 700/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:49.923519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038820-bea1-4698-8744-aa5edf031e84 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:49.923798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038820-bea1-4698-8744-aa5edf031e84 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:49.924164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038820-bea1-4698-8744-aa5edf031e84 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:49.925726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 666/1366] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 10 03:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:49.931744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bab8e-3954-4b6e-82a7-66ec052c5344 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:49.932022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bab8e-3954-4b6e-82a7-66ec052c5344 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:49.932293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bab8e-3954-4b6e-82a7-66ec052c5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:49.949806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6a4bab8e-3954-4b6e-82a7-66ec052c5344 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:49.950956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6a4bab8e-3954-4b6e-82a7-66ec052c5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:49.959811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 701/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 10 03:06:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:49.968245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038820-bea1-4698-8744-aa5edf031e84 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:49.982822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038820-bea1-4698-8744-aa5edf031e84 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:49.988239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:49.989004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:49.989402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:49.989684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:49.998683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:50.000287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6b10-ad4b-41d5-95c4-56269a6c26da service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:50.009758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 667/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:52.327097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bffb-1668-4325-a834-e55bcdd4fab4 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.328047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bffb-1668-4325-a834-e55bcdd4fab4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.328557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bffb-1668-4325-a834-e55bcdd4fab4 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.330171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 702/1369] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:06:52.335647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44193e8-08b1-4224-aee9-41e5f7d6c576 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.336454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44193e8-08b1-4224-aee9-41e5f7d6c576 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.337018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44193e8-08b1-4224-aee9-41e5f7d6c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.356923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c44193e8-08b1-4224-aee9-41e5f7d6c576 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:52.358423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c44193e8-08b1-4224-aee9-41e5f7d6c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:52.366422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 668/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:52.414119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bffb-1668-4325-a834-e55bcdd4fab4 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:52.429338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bffb-1668-4325-a834-e55bcdd4fab4 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:52.435947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:52.436613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.436928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.437506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.446968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:52.448733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528225f-61ef-4d9d-ad38-bc0932e8118f service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:52.459531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 703/1371] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:52.595817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1c07-3e39-4b34-adb7-5893b5644590 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.596007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1c07-3e39-4b34-adb7-5893b5644590 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.596280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1c07-3e39-4b34-adb7-5893b5644590 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.597898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 669/1372] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:52.604751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d609d-603b-4dbb-93ab-cb2bcaef32ed None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.605291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d609d-603b-4dbb-93ab-cb2bcaef32ed None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.605722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d609d-603b-4dbb-93ab-cb2bcaef32ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.626409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-344d609d-603b-4dbb-93ab-cb2bcaef32ed None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:52.628011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-344d609d-603b-4dbb-93ab-cb2bcaef32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:52.639322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 704/1373] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:52.963636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffbff-d76c-4988-bb29-2aebc235c3e7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.964071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffbff-d76c-4988-bb29-2aebc235c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.964455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffbff-d76c-4988-bb29-2aebc235c3e7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:52.966105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 670/1374] 10.222.0.55 () {54 vars in 963 bytes} [Tue May 10 03:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:52.971139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba77337-2452-4d2c-bc1d-be8667beede3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:52.971552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba77337-2452-4d2c-bc1d-be8667beede3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:52.971930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba77337-2452-4d2c-bc1d-be8667beede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:53.021369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-aba77337-2452-4d2c-bc1d-be8667beede3 None None] MFA Rules not processed for user `5afe79ba075a4f4da308f8d982d00869`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:53.022700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-aba77337-2452-4d2c-bc1d-be8667beede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:53.082431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 705/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Tue May 10 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:53.090973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ffbff-d76c-4988-bb29-2aebc235c3e7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:53.101773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ffbff-d76c-4988-bb29-2aebc235c3e7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:53.106675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:53.107388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:53.107733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:53.108069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:53.118229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:53.119926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e487e96-36b7-4aa3-934e-1beeeac6d744 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:53.129625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 671/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:06:54.728735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ffc1-423b-4f69-9892-2e6649bb4893 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:54.729629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ffc1-423b-4f69-9892-2e6649bb4893 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:54.729981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ffc1-423b-4f69-9892-2e6649bb4893 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:54.731501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 706/1377] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:54.737927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e193-6230-441d-a8c9-dfac2f42c796 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:54.738441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e193-6230-441d-a8c9-dfac2f42c796 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:54.738822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e193-6230-441d-a8c9-dfac2f42c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:54.762179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-11f6e193-6230-441d-a8c9-dfac2f42c796 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:54.763571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-11f6e193-6230-441d-a8c9-dfac2f42c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:54.772196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 672/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:54.822268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868ffc1-423b-4f69-9892-2e6649bb4893 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:54.838672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868ffc1-423b-4f69-9892-2e6649bb4893 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:54.844786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:54.845462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:54.845739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:54.846010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:54.855823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:54.857500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8afd7a-5611-4a4c-b425-eae164648064 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:54.869526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 707/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:57.181233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231602-30e8-40cc-acf4-f7183943bd18 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:57.181809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231602-30e8-40cc-acf4-f7183943bd18 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:57.181809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231602-30e8-40cc-acf4-f7183943bd18 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:57.183153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 673/1380] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:57.188537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa507ec-a29f-443a-a3a8-7cc99fecabb7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:57.188982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa507ec-a29f-443a-a3a8-7cc99fecabb7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:57.189135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa507ec-a29f-443a-a3a8-7cc99fecabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:57.207522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-caa507ec-a29f-443a-a3a8-7cc99fecabb7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:57.209014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-caa507ec-a29f-443a-a3a8-7cc99fecabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:57.217242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 708/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:57.261536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c231602-30e8-40cc-acf4-f7183943bd18 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:57.277970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c231602-30e8-40cc-acf4-f7183943bd18 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:57.283432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:57.284070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:57.284344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:57.284824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:57.293419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:57.294992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be360-fad0-4127-8eac-6f7f9d1dfc4e service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:57.305598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 674/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:06:59.585743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06304-568e-4090-bf9c-54753f6455c3 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:59.586318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06304-568e-4090-bf9c-54753f6455c3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:59.586318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06304-568e-4090-bf9c-54753f6455c3 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:59.588217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 709/1383] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:06:59.594049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7edfc-658a-4391-8596-494357478e93 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:59.594523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7edfc-658a-4391-8596-494357478e93 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:59.594627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7edfc-658a-4391-8596-494357478e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:59.614409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6de7edfc-658a-4391-8596-494357478e93 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:06:59.615833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6de7edfc-658a-4391-8596-494357478e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:06:59.625593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 675/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:06:59.670152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06304-568e-4090-bf9c-54753f6455c3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:06:59.684719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06304-568e-4090-bf9c-54753f6455c3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:06:59.690090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:06:59.690811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:06:59.691157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:06:59.691540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:06:59.700557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:06:59.702160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c2dc-ec2d-4e2b-8c4b-529df6468a18 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:06:59.712634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 710/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:02.051382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd12fa-e37c-481a-a70a-d14d54cd0451 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:02.051884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd12fa-e37c-481a-a70a-d14d54cd0451 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:02.051884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd12fa-e37c-481a-a70a-d14d54cd0451 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:02.053261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 676/1386] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:02.059657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be36-e605-4e99-9fc7-d291ef53922b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:02.060305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be36-e605-4e99-9fc7-d291ef53922b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:02.060305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be36-e605-4e99-9fc7-d291ef53922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:02.078580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-cb22be36-e605-4e99-9fc7-d291ef53922b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:02.079805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cb22be36-e605-4e99-9fc7-d291ef53922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:02.088131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 711/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:02.131096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd12fa-e37c-481a-a70a-d14d54cd0451 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:02.145439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd12fa-e37c-481a-a70a-d14d54cd0451 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:02.151766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:02.152405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:02.152712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:02.152987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:02.161830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:02.163391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea1e66-5b16-43ba-9e5e-9d6575aec073 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:02.173860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 677/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:04.474939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb335-bbee-4da4-9da9-66341d1f1f2c None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:04.475584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb335-bbee-4da4-9da9-66341d1f1f2c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:04.476082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb335-bbee-4da4-9da9-66341d1f1f2c None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:04.478164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 712/1389] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:04.483445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d0a3-664b-482b-a9cb-8c9fa8244032 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:04.483901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d0a3-664b-482b-a9cb-8c9fa8244032 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:04.484002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d0a3-664b-482b-a9cb-8c9fa8244032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:04.502309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8683d0a3-664b-482b-a9cb-8c9fa8244032 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:04.503496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8683d0a3-664b-482b-a9cb-8c9fa8244032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:04.512152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 678/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:04.558395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb335-bbee-4da4-9da9-66341d1f1f2c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:04.576102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb335-bbee-4da4-9da9-66341d1f1f2c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:04.582965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:04.583826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:04.584181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:04.584575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:04.595689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:04.597774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85b3a-2bfd-4548-bb82-829139967fb2 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:04.610116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 713/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:06.853074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e207-6597-4f82-aebf-2db3fb1773d2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:06.854064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e207-6597-4f82-aebf-2db3fb1773d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:06.854064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e207-6597-4f82-aebf-2db3fb1773d2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:06.854982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 679/1392] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:06.860207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613062c-75e4-42dd-899d-60bb4bacea7b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:06.860644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613062c-75e4-42dd-899d-60bb4bacea7b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:06.860780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613062c-75e4-42dd-899d-60bb4bacea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:06.878678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-a613062c-75e4-42dd-899d-60bb4bacea7b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:06.879875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a613062c-75e4-42dd-899d-60bb4bacea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:06.887496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 714/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:06.932191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e207-6597-4f82-aebf-2db3fb1773d2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:06.946325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e207-6597-4f82-aebf-2db3fb1773d2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:06.951843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:06.952479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:06.952817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:06.953092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:06.961232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:06.963515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ba79f-810d-4dd1-8ed7-d3f60abedf54 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:06.973084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 680/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:08.828747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb397-fd4f-43a0-8df6-d03838b09931 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:08.829355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb397-fd4f-43a0-8df6-d03838b09931 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:08.829355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb397-fd4f-43a0-8df6-d03838b09931 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:08.830760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 715/1395] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:08.836289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e085-1212-47fa-863f-a2c395829b4d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:08.837363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e085-1212-47fa-863f-a2c395829b4d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:08.837475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e085-1212-47fa-863f-a2c395829b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:08.855703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2438e085-1212-47fa-863f-a2c395829b4d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:08.856923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2438e085-1212-47fa-863f-a2c395829b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:08.864925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 681/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:08.920165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae4a2-e2cc-412f-b960-1501ede257a6 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:08.920457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae4a2-e2cc-412f-b960-1501ede257a6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:08.920774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae4a2-e2cc-412f-b960-1501ede257a6 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:08.922163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 716/1397] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 10 03:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:08.927352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657d4f-97a2-4b10-ac87-fc500b54957d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:08.927639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657d4f-97a2-4b10-ac87-fc500b54957d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:08.927916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657d4f-97a2-4b10-ac87-fc500b54957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:08.974892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3c657d4f-97a2-4b10-ac87-fc500b54957d None None] MFA Rules not processed for user `e2e8a60a8ef644e691a9a501ad2a4104`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:08.976055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3c657d4f-97a2-4b10-ac87-fc500b54957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:09.037925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 682/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 10 03:07:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:09.045819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ae4a2-e2cc-412f-b960-1501ede257a6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:09.057530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ae4a2-e2cc-412f-b960-1501ede257a6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:09.065450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:09.066096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.066373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.066643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.077405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:09.078878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb7b38-b9ea-4cc7-a5c5-e06ecd3bd02a service glance] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:09.088373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 717/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:09.212977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b748-2fdc-4851-9034-1b19708e5009 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.213288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b748-2fdc-4851-9034-1b19708e5009 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.213564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b748-2fdc-4851-9034-1b19708e5009 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.214956 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 683/1400] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:09.220432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaff05-41ba-4ab0-a917-1a0077eb6268 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.220753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaff05-41ba-4ab0-a917-1a0077eb6268 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.221034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaff05-41ba-4ab0-a917-1a0077eb6268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.240766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-21aaff05-41ba-4ab0-a917-1a0077eb6268 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:09.241961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-21aaff05-41ba-4ab0-a917-1a0077eb6268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:09.250550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 718/1401] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:09.299524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b748-2fdc-4851-9034-1b19708e5009 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:09.314541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b748-2fdc-4851-9034-1b19708e5009 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:09.319969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:09.320615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.320968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.321241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.329918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:09.331425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84373471-899c-4d6b-87b7-6ccbd8a483aa service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:09.341056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 684/1402] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:07:09.535333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e976d-dc49-458e-b30a-d920c8e3a0e5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.535612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e976d-dc49-458e-b30a-d920c8e3a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.535888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e976d-dc49-458e-b30a-d920c8e3a0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.587722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fb1e976d-dc49-458e-b30a-d920c8e3a0e5 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:09.588859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fb1e976d-dc49-458e-b30a-d920c8e3a0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:09.649737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 719/1403] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:07:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:09.695450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc89d-6529-4ec5-b1c9-4e29d63bd7d4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.695734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc89d-6529-4ec5-b1c9-4e29d63bd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.696053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc89d-6529-4ec5-b1c9-4e29d63bd7d4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.697475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 685/1404] 10.222.0.55 () {54 vars in 942 bytes} [Tue May 10 03:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:09.703765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f86ae-4968-425d-a1c5-94bd980f6656 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.704197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f86ae-4968-425d-a1c5-94bd980f6656 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.704621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f86ae-4968-425d-a1c5-94bd980f6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.753568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-995f86ae-4968-425d-a1c5-94bd980f6656 None None] MFA Rules not processed for user `40e88dcd650d4783979ca3fd848203bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:09.754782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-995f86ae-4968-425d-a1c5-94bd980f6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:09.823143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 720/1405] 10.222.0.55 () {58 vars in 1039 bytes} [Tue May 10 03:07:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:09.832549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc89d-6529-4ec5-b1c9-4e29d63bd7d4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:09.846511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc89d-6529-4ec5-b1c9-4e29d63bd7d4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:09.851374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:09.852016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:09.852946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:09.853210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:09.861474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:09.863041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540559e-af35-4487-8cd8-3b77f0c006d6 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:09.871182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 686/1406] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:07:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:07:11.656051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977e3e-534b-48fe-8264-efccb9a8cb67 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:11.657284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977e3e-534b-48fe-8264-efccb9a8cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:11.657284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977e3e-534b-48fe-8264-efccb9a8cb67 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:11.658798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 721/1407] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:11.673587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88595f71-9ae8-4542-aff9-b695822e860f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:11.674573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88595f71-9ae8-4542-aff9-b695822e860f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:11.677940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88595f71-9ae8-4542-aff9-b695822e860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:11.715850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-88595f71-9ae8-4542-aff9-b695822e860f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:11.717086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-88595f71-9ae8-4542-aff9-b695822e860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:11.725170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 687/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:11.769583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977e3e-534b-48fe-8264-efccb9a8cb67 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:11.805910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977e3e-534b-48fe-8264-efccb9a8cb67 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:11.815557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:11.816219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:11.816500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:11.816822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:11.827764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:11.829470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2f92-f6fe-48f4-9a88-a495c2cc18b6 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:11.840036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 722/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:33.418268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45186-b264-4222-8407-f7d95769110b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:33.418879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45186-b264-4222-8407-f7d95769110b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:33.418879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45186-b264-4222-8407-f7d95769110b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:33.420154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 688/1410] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 10 03:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:33.425359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb846a-509b-40a8-962c-cd1f77643a50 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:33.425826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb846a-509b-40a8-962c-cd1f77643a50 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:33.425950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb846a-509b-40a8-962c-cd1f77643a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:33.443700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dadb846a-509b-40a8-962c-cd1f77643a50 None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:33.444892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dadb846a-509b-40a8-962c-cd1f77643a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:33.453114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 723/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 10 03:07:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:07:33.466876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f711c1-5be8-47e7-9a7a-05a7e029cd88 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:33.467168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f711c1-5be8-47e7-9a7a-05a7e029cd88 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:33.467446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f711c1-5be8-47e7-9a7a-05a7e029cd88 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:33.468845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 689/1412] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 10 03:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:33.473359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f32ce6-6c52-4a61-bb4c-8d321f9943f7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:33.473644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f32ce6-6c52-4a61-bb4c-8d321f9943f7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:33.473920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f32ce6-6c52-4a61-bb4c-8d321f9943f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:33.491659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-58f32ce6-6c52-4a61-bb4c-8d321f9943f7 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:33.492839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-58f32ce6-6c52-4a61-bb4c-8d321f9943f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:33.502258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 724/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 10 03:07:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:36.200681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe763b4-deec-4462-be70-da8f85263e10 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:36.201246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe763b4-deec-4462-be70-da8f85263e10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:36.201246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe763b4-deec-4462-be70-da8f85263e10 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:36.202561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:36.207787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70096b6a-79a9-4381-85bc-7d00855876e5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:36.208198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70096b6a-79a9-4381-85bc-7d00855876e5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:36.208338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70096b6a-79a9-4381-85bc-7d00855876e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:36.226101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-70096b6a-79a9-4381-85bc-7d00855876e5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:36.227270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-70096b6a-79a9-4381-85bc-7d00855876e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:36.234951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:36.275803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe763b4-deec-4462-be70-da8f85263e10 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:36.289962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe763b4-deec-4462-be70-da8f85263e10 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:36.295324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:36.295953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:36.296231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:36.296504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:36.304342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:36.305944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77c391-fdc4-475d-8d94-75f529438758 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:36.315112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 691/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:37.300785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470ec0-402d-4113-9497-3366821ecf37 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:37.301355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470ec0-402d-4113-9497-3366821ecf37 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:37.301355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470ec0-402d-4113-9497-3366821ecf37 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:37.302689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:37.308104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417322-4f53-4930-8a99-8ef2430d5c7b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:37.308489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417322-4f53-4930-8a99-8ef2430d5c7b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:37.308647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417322-4f53-4930-8a99-8ef2430d5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:37.326558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ee417322-4f53-4930-8a99-8ef2430d5c7b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:37.327654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ee417322-4f53-4930-8a99-8ef2430d5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:37.335180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:37.487960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470ec0-402d-4113-9497-3366821ecf37 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:37.502356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470ec0-402d-4113-9497-3366821ecf37 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:37.507541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:37.508165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:37.508441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:37.508748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:37.516988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:37.518531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eba65-25b2-4b9d-bb94-4c738071f5b0 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:37.527999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 727/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:38.463570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cce8e3-969d-44bf-b37c-dfca2bee38df None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:38.464124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cce8e3-969d-44bf-b37c-dfca2bee38df None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:38.464124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cce8e3-969d-44bf-b37c-dfca2bee38df None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:38.465542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:38.470588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5992-2d72-4e60-812d-3d93b1ef23d9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:38.470986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5992-2d72-4e60-812d-3d93b1ef23d9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:38.471153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5992-2d72-4e60-812d-3d93b1ef23d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:38.489430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ac5a5992-2d72-4e60-812d-3d93b1ef23d9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:38.490617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ac5a5992-2d72-4e60-812d-3d93b1ef23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:38.499025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:38.645807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cce8e3-969d-44bf-b37c-dfca2bee38df None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:38.659957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cce8e3-969d-44bf-b37c-dfca2bee38df None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:38.665157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:38.666407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:38.666684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:38.666950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:38.674766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:38.676322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7964b-06a7-4301-9212-5741fa622f66 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:38.686061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 694/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:39.608024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4663-57bf-4056-95cc-fdc6c20c4c31 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:39.608574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4663-57bf-4056-95cc-fdc6c20c4c31 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:39.608574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4663-57bf-4056-95cc-fdc6c20c4c31 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:39.609949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:39.615263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62cc-db5b-49b1-b4ef-4cff6be0d73e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:39.615796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62cc-db5b-49b1-b4ef-4cff6be0d73e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:39.616071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62cc-db5b-49b1-b4ef-4cff6be0d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:39.633474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cb9a62cc-db5b-49b1-b4ef-4cff6be0d73e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:39.634661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb9a62cc-db5b-49b1-b4ef-4cff6be0d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:39.642111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:07:39.790944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4663-57bf-4056-95cc-fdc6c20c4c31 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:39.805882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4663-57bf-4056-95cc-fdc6c20c4c31 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:39.811163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:39.811790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:39.812068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:39.812338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:39.819948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:39.821631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9218b2-eeaa-4e5f-a29a-def8b13c3bde service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:39.830655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 730/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:40.755845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5350d-3b5c-4243-88db-0266a9ce898c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:40.756390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5350d-3b5c-4243-88db-0266a9ce898c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:40.756390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5350d-3b5c-4243-88db-0266a9ce898c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:40.757837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:40.762860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801418e-df02-48ec-b6b4-9b6ee88caf91 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:40.763296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801418e-df02-48ec-b6b4-9b6ee88caf91 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:40.763402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801418e-df02-48ec-b6b4-9b6ee88caf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:40.781194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7801418e-df02-48ec-b6b4-9b6ee88caf91 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:40.782354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7801418e-df02-48ec-b6b4-9b6ee88caf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:40.789915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:40.943965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5350d-3b5c-4243-88db-0266a9ce898c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:40.957744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5350d-3b5c-4243-88db-0266a9ce898c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:40.962920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:40.963546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:40.963822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:40.964087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:40.971824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:40.973413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22f475-621f-458b-9534-51359d35fce7 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:40.982974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 697/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:41.855482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac871a-2f62-4e72-9fba-d47c3c99c2c9 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:41.856033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac871a-2f62-4e72-9fba-d47c3c99c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:41.856033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac871a-2f62-4e72-9fba-d47c3c99c2c9 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:41.857471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:41.862325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505d2e-3b07-4889-bcbc-a58b563277ff None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:41.862768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505d2e-3b07-4889-bcbc-a58b563277ff None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:41.862882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505d2e-3b07-4889-bcbc-a58b563277ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:41.881397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-57505d2e-3b07-4889-bcbc-a58b563277ff None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:41.882609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-57505d2e-3b07-4889-bcbc-a58b563277ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:41.891756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:42.039854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac871a-2f62-4e72-9fba-d47c3c99c2c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:42.053902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac871a-2f62-4e72-9fba-d47c3c99c2c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:42.059753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:42.060385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:42.060680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:42.060994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:42.068997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:42.070555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278cd28-818c-48fa-b151-d7d5c245b1e0 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:42.080691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 733/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:42.942760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c53e3-9b14-4d75-baa2-cba55a062b8d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:42.943346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c53e3-9b14-4d75-baa2-cba55a062b8d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:42.943446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c53e3-9b14-4d75-baa2-cba55a062b8d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:42.944802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:42.950553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e95-1a1e-468e-9b28-a0c1292b61bf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:42.950962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e95-1a1e-468e-9b28-a0c1292b61bf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:42.951126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e95-1a1e-468e-9b28-a0c1292b61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:42.968818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6d315e95-1a1e-468e-9b28-a0c1292b61bf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:42.970013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6d315e95-1a1e-468e-9b28-a0c1292b61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:42.977536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:43.133332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c53e3-9b14-4d75-baa2-cba55a062b8d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:43.147628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c53e3-9b14-4d75-baa2-cba55a062b8d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:43.153489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:43.154112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:43.154386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:43.154654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:43.162935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:43.164539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a15c9-151e-43ab-a6d2-f98042816f65 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:43.173975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 700/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:44.042912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192c34-2a2c-4e8e-85ba-91ef043ae606 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:44.043445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192c34-2a2c-4e8e-85ba-91ef043ae606 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:44.043445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192c34-2a2c-4e8e-85ba-91ef043ae606 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:44.045030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:44.050323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099a52-0117-4ac6-93ac-9e7cd7c0afc7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:44.050751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099a52-0117-4ac6-93ac-9e7cd7c0afc7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:44.050900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099a52-0117-4ac6-93ac-9e7cd7c0afc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:44.068789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-23099a52-0117-4ac6-93ac-9e7cd7c0afc7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:44.069993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-23099a52-0117-4ac6-93ac-9e7cd7c0afc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:44.078249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:44.228886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192c34-2a2c-4e8e-85ba-91ef043ae606 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:44.242524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192c34-2a2c-4e8e-85ba-91ef043ae606 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:44.247813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:44.248435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:44.248742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:44.249017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:44.256781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:44.258335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49471fbe-f0b0-4aa9-a5ec-00e91ad25666 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:44.267464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 736/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:45.144022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f43-dbec-4637-8453-e3cd149b52b2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:45.144560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f43-dbec-4637-8453-e3cd149b52b2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:45.144679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f43-dbec-4637-8453-e3cd149b52b2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:45.146004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:45.150993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c357ab-5be3-435d-8bb3-6125b374e033 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:45.151441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c357ab-5be3-435d-8bb3-6125b374e033 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:45.151579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c357ab-5be3-435d-8bb3-6125b374e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:45.169363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-32c357ab-5be3-435d-8bb3-6125b374e033 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:45.170541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-32c357ab-5be3-435d-8bb3-6125b374e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:45.178178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:45.329683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957f43-dbec-4637-8453-e3cd149b52b2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:45.343630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957f43-dbec-4637-8453-e3cd149b52b2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:45.348932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:45.349561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:45.349841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:45.350109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:45.358613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:45.360170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b539489-3474-4345-825c-7541cd2d7ee0 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:45.369917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 703/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:47.447067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265908-bd7a-4eb0-b7d8-10fa596f54e5 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:47.447637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265908-bd7a-4eb0-b7d8-10fa596f54e5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:47.447637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265908-bd7a-4eb0-b7d8-10fa596f54e5 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:47.449001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:47.454324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641792b3-673e-45dd-b81b-d87b03574858 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:47.454714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641792b3-673e-45dd-b81b-d87b03574858 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:47.454878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641792b3-673e-45dd-b81b-d87b03574858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:47.472015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-641792b3-673e-45dd-b81b-d87b03574858 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:47.473224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-641792b3-673e-45dd-b81b-d87b03574858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:47.481582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:47.518491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a265908-bd7a-4eb0-b7d8-10fa596f54e5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:47.528806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a265908-bd7a-4eb0-b7d8-10fa596f54e5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:47.532763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:47.533398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:47.533679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:47.533953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:47.543650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:47.545110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f5415-e384-4e2d-aac5-066f17f0a568 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:47.554467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 739/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:49.920916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb2303-c456-453a-bea0-c56edc815c22 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:49.921475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb2303-c456-453a-bea0-c56edc815c22 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:49.921475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb2303-c456-453a-bea0-c56edc815c22 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:49.922867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:49.928134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6018-16e2-451a-82ba-6b1536439420 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:49.928564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6018-16e2-451a-82ba-6b1536439420 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:49.928706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6018-16e2-451a-82ba-6b1536439420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:49.946211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d40f6018-16e2-451a-82ba-6b1536439420 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:49.947400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d40f6018-16e2-451a-82ba-6b1536439420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:49.954964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:49.994600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb2303-c456-453a-bea0-c56edc815c22 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:50.005182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb2303-c456-453a-bea0-c56edc815c22 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:50.008645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:50.009773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:50.010056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:50.010332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:50.018992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:50.020409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6966bd-97a9-4fe9-944c-2eb580618f79 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:50.030650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 706/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:52.537357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdd6a-3057-400f-9a22-c692a9c25490 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:52.537921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdd6a-3057-400f-9a22-c692a9c25490 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:52.537921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdd6a-3057-400f-9a22-c692a9c25490 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:52.539287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:52.545457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19299-f4b8-4566-bb70-f9f01807f85a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:52.545895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19299-f4b8-4566-bb70-f9f01807f85a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:52.545993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19299-f4b8-4566-bb70-f9f01807f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:52.563031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4fc19299-f4b8-4566-bb70-f9f01807f85a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:52.564218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4fc19299-f4b8-4566-bb70-f9f01807f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:52.571816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:52.609847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcdd6a-3057-400f-9a22-c692a9c25490 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:52.620153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcdd6a-3057-400f-9a22-c692a9c25490 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:52.623552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:52.624174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:52.624449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:52.624752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:52.633373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:52.634859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60b59-1279-48ac-89cd-9f857aef5ed5 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:52.643893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 742/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:54.987424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745fd3-f734-49ea-ba0a-fdcc9e92d947 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:54.988047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745fd3-f734-49ea-ba0a-fdcc9e92d947 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:54.988047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745fd3-f734-49ea-ba0a-fdcc9e92d947 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:54.989370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:54.994559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cea28-461b-4efd-96db-05dad32104ef None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:54.994971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cea28-461b-4efd-96db-05dad32104ef None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:54.995182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cea28-461b-4efd-96db-05dad32104ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:55.012806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-579cea28-461b-4efd-96db-05dad32104ef None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:55.013973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-579cea28-461b-4efd-96db-05dad32104ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:55.022022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:55.061324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745fd3-f734-49ea-ba0a-fdcc9e92d947 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:55.072532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745fd3-f734-49ea-ba0a-fdcc9e92d947 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:55.076263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:55.076949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:55.077225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:55.077494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:55.086566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:55.088633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca6812-5c89-4b14-86cb-505e4c4e3590 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:55.098789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 709/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:57.374127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79200-d00d-419d-acb7-21deae91770d None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:57.374658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79200-d00d-419d-acb7-21deae91770d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:57.374658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b79200-d00d-419d-acb7-21deae91770d None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:57.375967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:57.381533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183769-63b5-49be-be46-b66982823b2a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:57.381958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183769-63b5-49be-be46-b66982823b2a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:57.382096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183769-63b5-49be-be46-b66982823b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:57.399283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9c183769-63b5-49be-be46-b66982823b2a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:57.400465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9c183769-63b5-49be-be46-b66982823b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:57.408387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:57.446375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b79200-d00d-419d-acb7-21deae91770d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:57.456639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b79200-d00d-419d-acb7-21deae91770d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:57.460307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:57.460976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:57.461255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:57.461526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:57.470308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:57.471711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f76e8-ebac-48df-8c82-e2013f079832 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:57.481352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 745/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:07:59.729492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:59.730073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:59.730073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:59.731422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:07:59.736674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fa0e-afc8-440b-b093-cbfe87bc1a90 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:59.737124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fa0e-afc8-440b-b093-cbfe87bc1a90 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:59.737307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fa0e-afc8-440b-b093-cbfe87bc1a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:59.755135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1da4fa0e-afc8-440b-b093-cbfe87bc1a90 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:07:59.756459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1da4fa0e-afc8-440b-b093-cbfe87bc1a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:59.764233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:07:59.803613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:07:59.805573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:07:59.819297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784e1a2-6948-4d0c-8a80-496eccbfd126 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:07:59.822979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:07:59.823613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:07:59.823891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:07:59.824165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:07:59.832845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:07:59.834290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77701af-c8b4-421f-8783-8faa8771e9e3 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:07:59.843917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 712/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:02.138584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9f58-b2c0-4917-8ed3-107982c5f447 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:02.139126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9f58-b2c0-4917-8ed3-107982c5f447 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:02.139126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9f58-b2c0-4917-8ed3-107982c5f447 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:02.140505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:02.145810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd08b2-a377-414c-a1b8-f3ff6a3198bf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:02.146248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd08b2-a377-414c-a1b8-f3ff6a3198bf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:02.146353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd08b2-a377-414c-a1b8-f3ff6a3198bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:02.165835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2fdd08b2-a377-414c-a1b8-f3ff6a3198bf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:02.167012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2fdd08b2-a377-414c-a1b8-f3ff6a3198bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:02.174573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:02.210760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9f58-b2c0-4917-8ed3-107982c5f447 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:02.221727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9f58-b2c0-4917-8ed3-107982c5f447 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:02.225395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:02.226035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:02.226316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:02.226593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:02.236325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:02.237764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585053-52f0-447b-8c80-9c55d31fc232 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:02.246785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 748/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:04.496114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737ac7-5c41-4380-b799-133b8a589758 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:04.496709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737ac7-5c41-4380-b799-133b8a589758 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:04.496709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737ac7-5c41-4380-b799-133b8a589758 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:04.498085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:04.503526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9444-f5cd-4d77-8104-53a934172cf3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:04.503924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9444-f5cd-4d77-8104-53a934172cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:04.504084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9444-f5cd-4d77-8104-53a934172cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:04.522520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2b6f9444-f5cd-4d77-8104-53a934172cf3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:04.523814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2b6f9444-f5cd-4d77-8104-53a934172cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:04.531838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:04.569610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737ac7-5c41-4380-b799-133b8a589758 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:04.580519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737ac7-5c41-4380-b799-133b8a589758 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:04.583960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:04.584586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:04.584889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:04.585158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:04.593975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:04.595391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d38d-f5b5-451e-9942-0d9ca3ec3e2a service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:04.604617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 715/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:06.915854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb40ad-4d90-478c-b9ac-f50d931458a5 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:06.916445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb40ad-4d90-478c-b9ac-f50d931458a5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:06.916445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb40ad-4d90-478c-b9ac-f50d931458a5 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:06.917774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:06.922998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1091-6d82-4214-9982-8f12b1e77c86 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:06.923441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1091-6d82-4214-9982-8f12b1e77c86 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:06.923537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1091-6d82-4214-9982-8f12b1e77c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:06.940524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9dac1091-6d82-4214-9982-8f12b1e77c86 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:06.941701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9dac1091-6d82-4214-9982-8f12b1e77c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:06.949725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:06.986407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb40ad-4d90-478c-b9ac-f50d931458a5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:06.997177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb40ad-4d90-478c-b9ac-f50d931458a5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:07.000515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:07.001171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:07.001448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:07.001717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:07.010388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:07.011773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e4b65-96e5-479f-92cd-8de871593dd8 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:07.020672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 751/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:09.313064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f5dc-e377-4e04-8536-6f81a068f6ee None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:09.313596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f5dc-e377-4e04-8536-6f81a068f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:09.313596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f5dc-e377-4e04-8536-6f81a068f6ee None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:09.314913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:09.320254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800cdd-75c1-4a0a-ad55-743c8e2f0689 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:09.320708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800cdd-75c1-4a0a-ad55-743c8e2f0689 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:09.320826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800cdd-75c1-4a0a-ad55-743c8e2f0689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:09.337989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-87800cdd-75c1-4a0a-ad55-743c8e2f0689 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:09.339230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-87800cdd-75c1-4a0a-ad55-743c8e2f0689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:09.346803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:09.382628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f5dc-e377-4e04-8536-6f81a068f6ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:09.393034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f5dc-e377-4e04-8536-6f81a068f6ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:09.396402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:09.397057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:09.397337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:09.397607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:09.406502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:09.407915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8ad3-8d64-49d5-a284-7831ed496b59 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:09.418069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 718/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:42.564578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05959b7-132a-49da-be02-68bbce7c9394 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:42.565203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05959b7-132a-49da-be02-68bbce7c9394 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:42.565203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05959b7-132a-49da-be02-68bbce7c9394 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:42.566569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 753/1471] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:42.572324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0538-ee8b-4ebf-9936-f81d01865bf8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:42.572918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0538-ee8b-4ebf-9936-f81d01865bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:42.572918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0538-ee8b-4ebf-9936-f81d01865bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:42.589910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bc1c0538-ee8b-4ebf-9936-f81d01865bf8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:42.591083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bc1c0538-ee8b-4ebf-9936-f81d01865bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:42.598631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 719/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:42.645250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedc94-9b04-43cd-8dcc-f50591fa8a41 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:42.645539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedc94-9b04-43cd-8dcc-f50591fa8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:42.645817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedc94-9b04-43cd-8dcc-f50591fa8a41 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:42.647173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 754/1473] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 10 03:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:42.651934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b464-0898-43ff-a8b9-106e905d353b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:42.652221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b464-0898-43ff-a8b9-106e905d353b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:42.652496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b464-0898-43ff-a8b9-106e905d353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:42.670430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6748b464-0898-43ff-a8b9-106e905d353b None None] MFA Rules not processed for user `e2e8a60a8ef644e691a9a501ad2a4104`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:42.671579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6748b464-0898-43ff-a8b9-106e905d353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:42.677784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 720/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 10 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:42.685312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedc94-9b04-43cd-8dcc-f50591fa8a41 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:42.696036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedc94-9b04-43cd-8dcc-f50591fa8a41 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:42.699527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:42.700145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:42.700423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:42.700725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:42.709327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:42.710735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2975d8-ae77-4021-a06a-218a49d1d447 service glance] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:42.719721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 755/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:08:44.999053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24f47-934f-4472-a78c-db7721cf9437 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:44.999623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24f47-934f-4472-a78c-db7721cf9437 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:44.999623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24f47-934f-4472-a78c-db7721cf9437 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:45.001030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 721/1476] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:45.006350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc51a-71a2-44c6-bd1f-c012289485c2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:45.006797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc51a-71a2-44c6-bd1f-c012289485c2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:45.006917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc51a-71a2-44c6-bd1f-c012289485c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:45.025003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-390dc51a-71a2-44c6-bd1f-c012289485c2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:45.026164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-390dc51a-71a2-44c6-bd1f-c012289485c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:45.033969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 756/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:08:45.056768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24f47-934f-4472-a78c-db7721cf9437 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:45.068940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24f47-934f-4472-a78c-db7721cf9437 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:45.073850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:45.074482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:45.074756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:45.075023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:45.075746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:45.077508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:08:45.077508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:08:45.077508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:08:45.078641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63effbb4-47ff-4c49-b7a8-dd2e13962043 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:45.096795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 722/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 10 03:08:45 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:08:47.327102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466eb8-4f7f-4bb1-8ee0-824f3a2cc17e None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:47.327675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466eb8-4f7f-4bb1-8ee0-824f3a2cc17e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:47.327675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466eb8-4f7f-4bb1-8ee0-824f3a2cc17e None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:47.329089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 757/1479] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:47.334396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0820f-0c84-4ecd-82da-980c2bed4ca3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:47.334838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0820f-0c84-4ecd-82da-980c2bed4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:47.334943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0820f-0c84-4ecd-82da-980c2bed4ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:47.353432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4da0820f-0c84-4ecd-82da-980c2bed4ca3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:47.354609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4da0820f-0c84-4ecd-82da-980c2bed4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:47.362322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 723/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:47.403906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466eb8-4f7f-4bb1-8ee0-824f3a2cc17e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:47.419584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466eb8-4f7f-4bb1-8ee0-824f3a2cc17e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:47.424900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:47.425529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:47.425803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:47.426073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:47.434439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:47.435991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19829941-928b-4dc4-a005-8ffc92c05c84 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:47.445815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 758/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:08:49.850822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc84aa-f255-4dad-a0c2-4997212e5ac1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:49.851854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc84aa-f255-4dad-a0c2-4997212e5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:49.851970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc84aa-f255-4dad-a0c2-4997212e5ac1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:49.853355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 724/1482] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:49.858769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2b64-2aa1-4db0-a152-c2f5ec566ce2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:49.859250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2b64-2aa1-4db0-a152-c2f5ec566ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:49.859355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2b64-2aa1-4db0-a152-c2f5ec566ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:49.877141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-108f2b64-2aa1-4db0-a152-c2f5ec566ce2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:49.878319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-108f2b64-2aa1-4db0-a152-c2f5ec566ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:49.886339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 759/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:49.921990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc84aa-f255-4dad-a0c2-4997212e5ac1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:49.933249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc84aa-f255-4dad-a0c2-4997212e5ac1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:49.936625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:49.937276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:49.937555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:49.937825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:49.946572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:49.947990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97bd53-5442-4925-a04d-3cdf5a014a8d service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:49.957005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 725/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:52.215447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a992b3-d3f5-41d3-8ee0-d2b4051278ff None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:52.216011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a992b3-d3f5-41d3-8ee0-d2b4051278ff None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:52.216011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a992b3-d3f5-41d3-8ee0-d2b4051278ff None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:52.217394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 760/1485] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:52.222659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465320-f7f6-44c8-aa16-5e14284c1693 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:52.223102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465320-f7f6-44c8-aa16-5e14284c1693 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:52.223207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465320-f7f6-44c8-aa16-5e14284c1693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:52.240217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a9465320-f7f6-44c8-aa16-5e14284c1693 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:52.241416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a9465320-f7f6-44c8-aa16-5e14284c1693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:52.248965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 726/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:52.286149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a992b3-d3f5-41d3-8ee0-d2b4051278ff None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:52.296391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a992b3-d3f5-41d3-8ee0-d2b4051278ff None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:52.303855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:52.303855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:52.303855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:52.303855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:52.310155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:52.311610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86153-285e-4ee6-923d-430573a839bb service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:52.321247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 761/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:54.610015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e320d3-db7d-450a-8b9a-93062543cb10 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:54.610590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e320d3-db7d-450a-8b9a-93062543cb10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:54.610590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e320d3-db7d-450a-8b9a-93062543cb10 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:54.611982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 727/1488] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:54.617821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002eaf-99d5-4535-a52c-b7ad4a96c7fd None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:54.618324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002eaf-99d5-4535-a52c-b7ad4a96c7fd None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:54.618823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002eaf-99d5-4535-a52c-b7ad4a96c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:54.636510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-93002eaf-99d5-4535-a52c-b7ad4a96c7fd None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:54.637711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-93002eaf-99d5-4535-a52c-b7ad4a96c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:54.645416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 762/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:54.686734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e320d3-db7d-450a-8b9a-93062543cb10 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:54.697811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e320d3-db7d-450a-8b9a-93062543cb10 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:54.701229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:54.701853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:54.702128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:54.702397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:54.710883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:54.712381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80185-ff49-4457-afe7-a465415cb9fc service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:54.721436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 728/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:08:57.167580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc12c-1d41-4c5b-ace8-4d556d24489b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:57.168178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc12c-1d41-4c5b-ace8-4d556d24489b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:57.168178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc12c-1d41-4c5b-ace8-4d556d24489b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:57.169575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 763/1491] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 10 03:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:08:57.174974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83132-2a65-4201-ac74-640890d976e0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:57.175451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83132-2a65-4201-ac74-640890d976e0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:57.175564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83132-2a65-4201-ac74-640890d976e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:57.193867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-63d83132-2a65-4201-ac74-640890d976e0 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:08:57.195589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-63d83132-2a65-4201-ac74-640890d976e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:08:57.203304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 729/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 10 03:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:08:57.241648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc12c-1d41-4c5b-ace8-4d556d24489b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:08:57.252334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc12c-1d41-4c5b-ace8-4d556d24489b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:08:57.255797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:08:57.256423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:08:57.256737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:08:57.257008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:08:57.266228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:08:57.267629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195648be-c32c-402c-8044-ee2562772c53 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:08:57.277395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 764/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:24.595360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.596000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.596000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.613464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:24.614655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:24.622889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 730/1494] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:24.632864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.633349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.633453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.651130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:24.652310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:24.660216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 765/1495] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:24.665088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.674861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0907b-4184-43b5-885d-5c4c2f4381af None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.680273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.680973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.681251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.681520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.682244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:10:24.682546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.683637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.683637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:10:24.683637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:10:24.684512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.696541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 731/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:10:24.704778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.713836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f965-6907-4ff0-bbfc-a7cb29ea6c1b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.718299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.718950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.719267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.719542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.720219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.722030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.722030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:10:24.722030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:10:24.723214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.761111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 766/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:10:24 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:10:24.765420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.775441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabaa4-700f-4c22-a20c-b3e7fcab53f0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.829253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.829905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.830182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.830455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.831127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.832152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.832152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:10:24.832152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:10:24.833375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.852476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 732/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:10:24 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:10:24.856639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.867822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e9ae-0460-4fd9-9100-531983152a93 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.872487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.873162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.873444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.873717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.874430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.875457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.875457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:10:24.875457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:10:24.876323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.889183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 767/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:10:24.892971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.903035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ac1b-bc8e-4881-8263-11cea5c83ea9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.907868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.908517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.908845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.909120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.909842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.910847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.910847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:10:24.910847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:10:24.911741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0e1e9-5205-4e5f-abd3-08be6d681a49 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.925165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 733/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:10:24.929908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:24.939329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b096-9f86-498f-8447-0da12bf96e55 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:24.944027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:24.944902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.945178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.945445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] PATH_INFO: `/v3/projects/13e057f013c149ff906eec6c4f922ab5/users/92e9176aa8a9490da0c909c9b1e8e02d/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:24.959801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e057f013c149ff906eec6c4f922ab5, user_id=92e9176aa8a9490da0c909c9b1e8e02d, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:24.960861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:24.960861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:10:24.960861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:10:24.962761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293ee38-da53-4a9d-b46e-56c8b8feb645 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:24.975602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 768/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:10:24 2022] PUT /identity/v3/projects/13e057f013c149ff906eec6c4f922ab5/users/92e9176aa8a9490da0c909c9b1e8e02d/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:10:24.986778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9eda-74da-4978-b189-9718551dea99 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:24.987058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9eda-74da-4978-b189-9718551dea99 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:24.987377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9eda-74da-4978-b189-9718551dea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.013261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-002b9eda-74da-4978-b189-9718551dea99 None None] MFA Rules not processed for user `92e9176aa8a9490da0c909c9b1e8e02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:25.014450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-002b9eda-74da-4978-b189-9718551dea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.077439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 734/1502] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:25.091038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b541-e398-4fce-a122-144e7d2b3b31 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.091326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b541-e398-4fce-a122-144e7d2b3b31 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.091601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b541-e398-4fce-a122-144e7d2b3b31 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.092984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 769/1503] 10.222.0.55 () {54 vars in 963 bytes} [Tue May 10 03:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:25.097694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4a-e22b-4d35-becb-9a6e314d118d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.097986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4a-e22b-4d35-becb-9a6e314d118d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.098266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612b4a-e22b-4d35-becb-9a6e314d118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.116606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b7612b4a-e22b-4d35-becb-9a6e314d118d None None] MFA Rules not processed for user `5afe79ba075a4f4da308f8d982d00869`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:25.117857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b7612b4a-e22b-4d35-becb-9a6e314d118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.165354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 735/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Tue May 10 03:10:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:25.172694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b541-e398-4fce-a122-144e7d2b3b31 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:25.183352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b541-e398-4fce-a122-144e7d2b3b31 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:25.186775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:25.187392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.187669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.187938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.195818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:25.197283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:25.205571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 770/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:10:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:25.248346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a537-283d-40ed-ae57-c419f9fe34eb None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.248634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a537-283d-40ed-ae57-c419f9fe34eb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.248952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a537-283d-40ed-ae57-c419f9fe34eb None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.250241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 736/1506] 10.222.0.55 () {52 vars in 829 bytes} [Tue May 10 03:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:25.253824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:25.312884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba8f25-8203-48ad-9008-740597405dab service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:25.317258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:25.318139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.318415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.318688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] PATH_INFO: `/v3/users/92e9176aa8a9490da0c909c9b1e8e02d` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.320436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e9176aa8a9490da0c909c9b1e8e02d)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:25.321460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:25.321460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:10:25.321460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:10:25.322658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:25.384156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e9176aa8a9490da0c909c9b1e8e02d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:25.395767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e9176aa8a9490da0c909c9b1e8e02d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:25.396508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e9176aa8a9490da0c909c9b1e8e02d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:25.405081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e9176aa8a9490da0c909c9b1e8e02d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:25.405702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e9176aa8a9490da0c909c9b1e8e02d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:25.431430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 771/1507] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:10:25 2022] DELETE /identity/v3/users/92e9176aa8a9490da0c909c9b1e8e02d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:10:25.436023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.436307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.436584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.454197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:25.455364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.509953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 737/1508] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:25.519992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:25.521388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.575594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632b431-1769-45b6-95c9-6bfd27c02d71 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:25.579135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:25.579769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.580045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.580317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.588865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:25.590271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcaa2d-ced6-4fc2-8e45-e5d168ce52f8 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:25.599260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 772/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:10:25.916969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:25.918398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.930852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12bd0e-69a4-4299-a83f-c85362dc7c8e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:25.941766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:25.942772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.943163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.943903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] PATH_INFO: `/v3/projects/13e057f013c149ff906eec6c4f922ab5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.945535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e057f013c149ff906eec6c4f922ab5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:25.946567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:10:25.946567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:10:25.946567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:10:25.947795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:26.006335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e057f013c149ff906eec6c4f922ab5', 'request_id': 'req-00e9a904-3ffe-4840-84cc-017e309526d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:26.012146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e057f013c149ff906eec6c4f922ab5', 'request_id': 'req-00e9a904-3ffe-4840-84cc-017e309526d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:26.022977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e057f013c149ff906eec6c4f922ab5', 'request_id': 'req-00e9a904-3ffe-4840-84cc-017e309526d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:26.042133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] The token cache is being invalidate because project 13e057f013c149ff906eec6c4f922ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:10:26.042389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:26.043028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-00e9a904-3ffe-4840-84cc-017e309526d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:10:26.044746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 738/1510] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:10:25 2022] DELETE /identity/v3/projects/13e057f013c149ff906eec6c4f922ab5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:12:04.754691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:04.755305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:04.755305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:04.757688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:04.762744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a046f-3412-4b85-aafe-fb52b6d21a20 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:04.763179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a046f-3412-4b85-aafe-fb52b6d21a20 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:04.763287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a046f-3412-4b85-aafe-fb52b6d21a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:04.781282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-903a046f-3412-4b85-aafe-fb52b6d21a20 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:04.782716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-903a046f-3412-4b85-aafe-fb52b6d21a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:04.838889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:05.011582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:05.013564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:05.104416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2a8b6-e945-40de-8476-2f442b14add2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:05.109660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:05.110298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.110576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.110848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.118862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:05.120427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87c78c-8d23-4d5a-bc60-5bcd637a3356 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:05.129426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 774/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:05.466036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be32f-6864-450b-87c9-74cd23dde6df None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.466436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be32f-6864-450b-87c9-74cd23dde6df None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.466812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be32f-6864-450b-87c9-74cd23dde6df None None] PATH_INFO: `/v3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.468204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 740/1514] 10.222.0.64 () {54 vars in 925 bytes} [Tue May 10 03:12:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:12:05.474801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b81e8-2088-43d6-a721-c7508f9867e1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.475178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b81e8-2088-43d6-a721-c7508f9867e1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.475599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b81e8-2088-43d6-a721-c7508f9867e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.493905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-692b81e8-2088-43d6-a721-c7508f9867e1 None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:05.495079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-692b81e8-2088-43d6-a721-c7508f9867e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:05.574522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 775/1515] 10.222.0.64 () {58 vars in 1015 bytes} [Tue May 10 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:06.040228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c09e-2b88-473e-9fbc-5de91a4061a4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.040833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c09e-2b88-473e-9fbc-5de91a4061a4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.040925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c09e-2b88-473e-9fbc-5de91a4061a4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.042275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 741/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:12:06.047080 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8803-ae39-47d1-9909-9f73a2124ebb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.047512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8803-ae39-47d1-9909-9f73a2124ebb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.047634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8803-ae39-47d1-9909-9f73a2124ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.065468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4bae8803-ae39-47d1-9909-9f73a2124ebb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:06.066674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4bae8803-ae39-47d1-9909-9f73a2124ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:06.076005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 776/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:06.227393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c09e-2b88-473e-9fbc-5de91a4061a4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:06.241121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c09e-2b88-473e-9fbc-5de91a4061a4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:06.246280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:06.246903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.247178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.247447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.255290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:06.257479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756d91c-e549-45c8-b6ac-398c63d96efa service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:06.266527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 742/1518] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:09.377289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb2e4-5b44-417f-abf5-4300550df89b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:09.377806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb2e4-5b44-417f-abf5-4300550df89b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:09.377806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb2e4-5b44-417f-abf5-4300550df89b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:09.379142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 777/1519] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 10 03:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:09.384894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f648-e9d3-4753-88ca-345f67579777 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:09.385330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f648-e9d3-4753-88ca-345f67579777 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:09.385441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f648-e9d3-4753-88ca-345f67579777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:09.403353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bb08f648-e9d3-4753-88ca-345f67579777 None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:09.404520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bb08f648-e9d3-4753-88ca-345f67579777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:09.413266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 743/1520] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 10 03:12:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:09.421973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb2e4-5b44-417f-abf5-4300550df89b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:09.435883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb2e4-5b44-417f-abf5-4300550df89b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:09.440671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:09.441330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:09.441616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:09.441887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:09.450595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:09.452168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e1696-f4c2-4890-bc24-133e13e56bb2 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:09.461530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 778/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:17.599466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084fa5c-6edf-4b5a-8a69-c6e7e4060026 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:17.600693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084fa5c-6edf-4b5a-8a69-c6e7e4060026 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:17.600693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084fa5c-6edf-4b5a-8a69-c6e7e4060026 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:17.601928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:17.606760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581fad-34a1-4ad8-9c97-4cd30e314d1e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:17.607285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581fad-34a1-4ad8-9c97-4cd30e314d1e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:17.607393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581fad-34a1-4ad8-9c97-4cd30e314d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:17.625512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-10581fad-34a1-4ad8-9c97-4cd30e314d1e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:17.626668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-10581fad-34a1-4ad8-9c97-4cd30e314d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:17.634255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:17.789535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084fa5c-6edf-4b5a-8a69-c6e7e4060026 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:17.803802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084fa5c-6edf-4b5a-8a69-c6e7e4060026 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:17.809274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:17.809902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:17.810177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:17.810446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:17.818240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:17.819967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415ad6e-4067-4c26-ae51-00829376b6b7 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:17.828973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 745/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:18.716713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ede5a-930d-460a-9331-2a1e6d0c8392 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.717297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ede5a-930d-460a-9331-2a1e6d0c8392 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.717297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ede5a-930d-460a-9331-2a1e6d0c8392 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.718614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:18.723457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17773-be82-4379-8fdb-1f981cfc15c9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.723899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17773-be82-4379-8fdb-1f981cfc15c9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.724023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17773-be82-4379-8fdb-1f981cfc15c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.741854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8bc17773-be82-4379-8fdb-1f981cfc15c9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:18.743034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8bc17773-be82-4379-8fdb-1f981cfc15c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:18.750726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:18.902291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ede5a-930d-460a-9331-2a1e6d0c8392 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:18.916851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ede5a-930d-460a-9331-2a1e6d0c8392 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:18.922239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:18.922873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.923155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.923433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.931780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:18.933422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac0c2-1985-421d-ad84-49ad39f375a9 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:18.942643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 781/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:22.930367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:22.930945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:22.930945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:22.932326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:22.937452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6878a-fa72-4dd4-88d8-3849f9ca1006 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:22.937849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6878a-fa72-4dd4-88d8-3849f9ca1006 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:22.938006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6878a-fa72-4dd4-88d8-3849f9ca1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:22.955987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9bf6878a-fa72-4dd4-88d8-3849f9ca1006 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:22.957207 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9bf6878a-fa72-4dd4-88d8-3849f9ca1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:22.965437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:23.000726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:23.002373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:23.060205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e0dd-5599-4137-8a0e-be81dba12f85 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:23.063723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:23.064367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:23.064670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:23.064948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:23.074898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:23.076319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8891c-df57-4c85-9f1c-60427ec42d61 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:23.085423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 748/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:25.302876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8132-64f5-4895-97c0-5546ef0b4c40 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:25.303436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8132-64f5-4895-97c0-5546ef0b4c40 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:25.303542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8132-64f5-4895-97c0-5546ef0b4c40 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:25.304889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:25.310121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3335-6846-467a-923c-5cbd202df445 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:25.310552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3335-6846-467a-923c-5cbd202df445 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:25.310661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3335-6846-467a-923c-5cbd202df445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:25.328327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5a7f3335-6846-467a-923c-5cbd202df445 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:25.329486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5a7f3335-6846-467a-923c-5cbd202df445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:25.337717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:25.373003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d8132-64f5-4895-97c0-5546ef0b4c40 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:25.383529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d8132-64f5-4895-97c0-5546ef0b4c40 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:25.387012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:25.387639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:25.387918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:25.388193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:25.397401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:25.398815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16645f56-4ba2-4fdc-bb45-1f04f87cad3a service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:25.408084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 784/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:29.147914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:29.148466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:29.148466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:29.149867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:12:29.155236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f9d7-55ba-4bd6-af72-220c6e15d5e0 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:29.155651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f9d7-55ba-4bd6-af72-220c6e15d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:29.155788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f9d7-55ba-4bd6-af72-220c6e15d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:29.173555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9524f9d7-55ba-4bd6-af72-220c6e15d5e0 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:29.174739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9524f9d7-55ba-4bd6-af72-220c6e15d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:29.183119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:29.457666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:29.460121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:29.514545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f80d6-e5a0-41f8-97ab-5978c0d95ad3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:29.518011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:29.518644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:29.518923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:29.519190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:29.528407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:29.529855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408aa40-c8f1-45ab-97e4-0ccfa1c5f097 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:29.539154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 751/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:31.815462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:31.816015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:31.816015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:31.817407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:31.823059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0603a2-9b27-45a0-a643-4413b1737d03 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:31.823550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0603a2-9b27-45a0-a643-4413b1737d03 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:31.823644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0603a2-9b27-45a0-a643-4413b1737d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:31.847808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ef0603a2-9b27-45a0-a643-4413b1737d03 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:31.849565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef0603a2-9b27-45a0-a643-4413b1737d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:31.857679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:32.127984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:32.129658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:32.142305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653694de-f267-45ac-8c5a-99cf8d7f3f6f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:32.145739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:32.146931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:32.147212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:32.147488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:32.156110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:32.157811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeeda1-392c-434c-bc63-ec409f2ede3c service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:32.167853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 787/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:02.012436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.013560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.014059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.047893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.049546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.063144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 753/1540] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.071771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.072340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.072340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.100086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.101454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.117236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 788/1541] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.121579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.137352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771a5b3-7ee9-418e-b003-87979da3d684 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.142198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.142867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.143145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.143415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.144150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:02.144450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.146738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.165944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 754/1542] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:02.174247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.189922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7c2b5-2df6-46ee-a690-5c52ae141373 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.195608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.196296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.196579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.196878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.197589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.199833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.251218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 789/1543] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/projects => generated 405 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:02.256045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.272986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec17e-0dfc-427b-b640-a224fd0e9cb7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.350931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.351623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.351906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.352258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.352990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.355141 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.392598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 755/1544] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:02.397686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.417255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22dba3-07a7-450b-b30d-531d1b0a3923 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.428723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.429432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.429717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.429995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.430751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.432907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c68a70-ac82-4220-9e4f-3b15f884c3ef admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.452441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 790/1545] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:02.456179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.472499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f000-40ca-46fa-a54c-5ea9f3a57d10 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.473341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f000-40ca-46fa-a54c-5ea9f3a57d10 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.473829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173f000-40ca-46fa-a54c-5ea9f3a57d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.474499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf4e1e-63b5-49da-bd63-7f7378bd4f69 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.483048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.485041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.485329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.485592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.486354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.488173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b72775-013e-41c6-9805-75582f2f9276 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.505917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 756/1546] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:02.511676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.512044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.512393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.530745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0173f000-40ca-46fa-a54c-5ea9f3a57d10 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.532693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0173f000-40ca-46fa-a54c-5ea9f3a57d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.543334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.544710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.554048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 757/1547] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.554930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.561920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 791/1548] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:02.569370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646089af-6a22-472d-bcf3-5da307875ae8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.569668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646089af-6a22-472d-bcf3-5da307875ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.569934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646089af-6a22-472d-bcf3-5da307875ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.571045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c04a-45f7-42dd-bca0-3163d02853d3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.575883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.576893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.577251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.577463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] PATH_INFO: `/v3/projects/a691e60592ef4e128588ccd917030306/users/7c8ac27fbc6e45559663ebc748fec84b/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.605175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a691e60592ef4e128588ccd917030306, user_id=7c8ac27fbc6e45559663ebc748fec84b, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.606414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:02.606414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:14:02.606414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:14:02.608474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0303-8228-4dd4-b463-655f7d2004c8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.614454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-646089af-6a22-472d-bcf3-5da307875ae8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.615842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-646089af-6a22-472d-bcf3-5da307875ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.628040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 792/1549] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.630307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c983f5-fd47-4f12-90c6-4e0115109778 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.630675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c983f5-fd47-4f12-90c6-4e0115109778 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.631160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c983f5-fd47-4f12-90c6-4e0115109778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.635571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 758/1550] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:02 2022] PUT /identity/v3/projects/a691e60592ef4e128588ccd917030306/users/7c8ac27fbc6e45559663ebc748fec84b/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:02.637607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.637899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.638711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.666897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d2c983f5-fd47-4f12-90c6-4e0115109778 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.668116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d2c983f5-fd47-4f12-90c6-4e0115109778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.680390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.682117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.732826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 793/1551] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.734194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de435388-8989-4155-8f8f-0d5bb8113d58 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.734490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de435388-8989-4155-8f8f-0d5bb8113d58 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.734771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de435388-8989-4155-8f8f-0d5bb8113d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.749836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 759/1552] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.750866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.752553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-de435388-8989-4155-8f8f-0d5bb8113d58 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.753777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-de435388-8989-4155-8f8f-0d5bb8113d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.761088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31cdd9-0ab7-4fb8-8798-eef818f90747 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.762543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 794/1553] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.763774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.764061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.764335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.765769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.766679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.766958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.767335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.768066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:02.768370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.770072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207136-09b2-4582-9de8-90e95af33f7d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.781705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 760/1554] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:02.783210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5298a-e802-41fa-8f6a-2fb8fb804404 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.783489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5298a-e802-41fa-8f6a-2fb8fb804404 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.783762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5298a-e802-41fa-8f6a-2fb8fb804404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.790879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] MFA Rules not processed for user `7c8ac27fbc6e45559663ebc748fec84b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.792058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.802553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-89b5298a-e802-41fa-8f6a-2fb8fb804404 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.803726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-89b5298a-e802-41fa-8f6a-2fb8fb804404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.811803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 761/1555] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.813166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944204-cafe-4b8a-86e0-3c5cb2bb3165 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.813459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944204-cafe-4b8a-86e0-3c5cb2bb3165 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.813872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944204-cafe-4b8a-86e0-3c5cb2bb3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.831909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-75944204-cafe-4b8a-86e0-3c5cb2bb3165 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.833195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-75944204-cafe-4b8a-86e0-3c5cb2bb3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.840930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 762/1556] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.842248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4728-e6a8-4f2d-8912-bb5557da164c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.842610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4728-e6a8-4f2d-8912-bb5557da164c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.842910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4728-e6a8-4f2d-8912-bb5557da164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.856124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 795/1557] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.857048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.863634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-403c4728-e6a8-4f2d-8912-bb5557da164c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.865635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-403c4728-e6a8-4f2d-8912-bb5557da164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.867705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5f85-6343-4ba8-9691-453f0381fb76 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.872094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.872772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.873060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.873335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.873445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 763/1558] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.874057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:02.874436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.874648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.874934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.875210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.875438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:02.875438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:14:02.875438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:14:02.876327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47369d6e-ad1b-40b9-944b-b68d102cd272 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.888708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 796/1559] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:02.890126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b539d-3e5e-4af8-881a-3b7ffb9d1d79 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.890429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b539d-3e5e-4af8-881a-3b7ffb9d1d79 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.891169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b539d-3e5e-4af8-881a-3b7ffb9d1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.896716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.897896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.905659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 764/1560] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.906394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.908940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7e8b539d-3e5e-4af8-881a-3b7ffb9d1d79 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.910117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7e8b539d-3e5e-4af8-881a-3b7ffb9d1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.915745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b5086-57a7-4b41-bd9e-96d82bea6d39 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:02.918669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 797/1561] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.920329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:02.920747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073fa0-84c5-4c90-93f6-d8c1cbd95021 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.920993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.921123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073fa0-84c5-4c90-93f6-d8c1cbd95021 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.921286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.921397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073fa0-84c5-4c90-93f6-d8c1cbd95021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.921594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.922418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:02.923203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:02.923203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:14:02.923203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:14:02.924441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:02.939311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9f073fa0-84c5-4c90-93f6-d8c1cbd95021 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.940951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9f073fa0-84c5-4c90-93f6-d8c1cbd95021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:02.950062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 798/1562] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:02.953764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 765/1563] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:02.953764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:02.954005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3691-4acd-4343-9236-bedf0c54c24b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:02.954005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3691-4acd-4343-9236-bedf0c54c24b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:02.954005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3691-4acd-4343-9236-bedf0c54c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:02.970481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9a3c3691-4acd-4343-9236-bedf0c54c24b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:02.971672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9a3c3691-4acd-4343-9236-bedf0c54c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:03.012690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7440-3616-4ef2-bd6b-e766481583e4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.017165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.017815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.018095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.018370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.019047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.021019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.027787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 799/1564] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:03.029092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.029649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.029649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.049079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:03.050242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:03.052043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 766/1565] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:02 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.052943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.109220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 800/1566] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:03.110061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.112919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b701aa-2978-4c9d-9c06-3c8b7e2c96f2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.118743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.119328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e4ddf-f430-409a-adb2-8a42e84f461f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.119435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.119691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.119963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.120709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.122628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.123756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.124396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.124695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.124968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.125693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:03.126015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.127590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.138607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 801/1567] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:03.139448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.148691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 767/1568] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.148906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.154486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d33f-6faf-43fa-9e12-722e44a6f32f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.208278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3617-510a-416a-8c98-adc69621b294 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.208523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.208967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.209251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.209523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.210237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:03.210538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.212117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.212774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.213431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.213714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.213987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.214718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.216636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.224212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 802/1569] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:03.225056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.234734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f246f9-8f98-4338-a2ed-839ccaa1f2f7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.237436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 768/1570] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.238245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.240681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.240681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.240941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.241214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.241933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:03.242237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.243849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.248533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57512515-91c1-4e0a-85e2-57b68539b0d9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.253018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.253647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.253926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.254195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.255025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:03.255326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.256052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 803/1571] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:03.256848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.257042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.273686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 769/1572] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:03.273686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.277158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6467f-e253-4c1f-b928-b2a35a084765 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.278969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ab48-c5eb-4180-9d28-e72de9442f60 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.281856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.282923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.283227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.283499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.283607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.284181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.284292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.284476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.284775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.285210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:03.285210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:14:03.285210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:14:03.285459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:03.286390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.287010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.287930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.306544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 770/1573] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:03.306544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.310025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb08f1-04d6-422f-b8d4-e6389f99a5b8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.314642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.318362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 804/1574] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 308 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.318517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.318517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.318714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.318823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.318823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.319457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.325916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339e77-2584-4fcc-a1d0-711d3d0af056 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.330630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.331361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.331640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.331909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.332891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.335058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.345337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 771/1575] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.346465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.361905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 805/1576] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.361905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.370203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d58e-f8e9-436d-92d2-fa7fff1c14db admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.405861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0a7f0-6f0e-4ef1-aad3-c75f20ebb63b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.411250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.412092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.412378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.412646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.413353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.415235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.426012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.427190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.427467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.427735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.428447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.430404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.441246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 806/1577] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.442383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.442841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 772/1578] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.443330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.453786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d69d-8c5e-4f37-8a58-b03c6240bc8e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.504120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760adb-ba31-43dd-8f9f-13715a431228 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.507201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.507861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.508139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.508411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.509123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.509429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.510088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.510369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.510646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.511007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.511332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.513272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.537952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 807/1579] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.538862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.544611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 773/1580] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.544611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.599078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446075f-467f-4d77-a304-7a9ac508df7d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.603509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f450bd-2247-4885-a414-66ea1a780dd4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.603636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.604424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.604740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.605020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.605737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.607619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.610911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.612069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.612612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.613158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.614618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.617772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.628847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 774/1581] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.632937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.633100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 808/1582] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.633912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.642479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22003a3b-0a60-4995-a46c-19906abf7b3b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.694931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f1b-7b5e-4c05-af4d-d8f5bf9cc5c5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.696509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.697204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.697485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.697758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.698440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.699592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.700299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.700421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.700574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.700874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.701585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.703164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.714098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 809/1583] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.714899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.721520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 775/1584] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.722411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.728075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28ead-bec2-4346-82ea-8221b42da067 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.732608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.732792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4e09-3bbd-4b9e-a31d-fda3936085e0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.733413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.733685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.733960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.734812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.736431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.737573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.738238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.738513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.738902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.739638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.741609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.746546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 810/1585] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.747365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.757741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4b5d-0c63-4623-9db7-e731c787c9e1 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.764548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 776/1586] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.764548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.765508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.766159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.766437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.766709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.767383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.769323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.774223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254ca2-9dba-4d02-8585-06f17bdf1fcc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.778981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.779634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.779912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.780184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.780939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.783152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.791199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 811/1587] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.792022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.801968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee137-24d1-4f0e-9100-3dbce2c44c92 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.806870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.807495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 777/1588] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.807738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.808019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.808282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.808387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] PATH_INFO: `/v3/projects/749ebc772f1f430aa53f12ee575e0bf8/users/88941d165fcc4d1f8c22186e34c2deb2/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.817344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59d74a-d5b6-4eca-a353-0730e69e4d6f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.821897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.822542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.822818 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.822921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749ebc772f1f430aa53f12ee575e0bf8, user_id=88941d165fcc4d1f8c22186e34c2deb2, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.823088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.823757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.825575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.825679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.838998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 812/1589] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:03 2022] PUT /identity/v3/projects/749ebc772f1f430aa53f12ee575e0bf8/users/88941d165fcc4d1f8c22186e34c2deb2/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:03.840112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.849634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 778/1590] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:03 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:03.849634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.856748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24dd9b-e9ba-4884-b0f3-e0f886541888 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.901830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c81841-ea24-41f5-832e-92dca55edc52 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.906698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.907621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.907898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.908166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.908902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.910293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.911055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.911479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.911900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.912176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.912933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.914518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.920482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 813/1591] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.921285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.924024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 779/1592] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.924779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.931258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daa35-267b-4105-88bc-0eb6a53c3262 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.934650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270243-66e1-4409-bf04-1df08cfe7edb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.935799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.936677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.936962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.937235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] PATH_INFO: `/v3/projects/f4149fee898c44c180ae1de15ac9d9da/users/a8a3337faba84d0aa85df4121ffb5cd2/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.939268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:03.939900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:03.940176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:03.940444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:03.941190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.942963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.951746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4149fee898c44c180ae1de15ac9d9da, user_id=a8a3337faba84d0aa85df4121ffb5cd2, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:03.952497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 780/1593] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:03.953306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:03.954503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:03.965833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabda7-0185-42c2-8073-221122d16317 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:03.968775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 814/1594] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:03 2022] PUT /identity/v3/projects/f4149fee898c44c180ae1de15ac9d9da/users/a8a3337faba84d0aa85df4121ffb5cd2/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:03.969703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.023694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.024403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.024712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.024980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.025710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.027291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.029593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106274c-9311-4aa8-891e-f2374ae8efff admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.034513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.035292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.036090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.036866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.037632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 781/1595] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.037777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.038501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.039250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.049277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd348-2883-407c-bf1b-9abb573a9a07 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.049754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 815/1596] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.050473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.061211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.061885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.062163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.062457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.063190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.063285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1e4b-7b02-46fa-823b-0f3d1ba3c42c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.064810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.068097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.068782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.069065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.069344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.070082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.071643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.075240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 782/1597] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.075842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.083296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 816/1598] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.084158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.085561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95e09-ff0b-4e27-9495-eb9524e9f5c3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.089989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.090847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.091125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.091396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] PATH_INFO: `/v3/projects/857b83406e874fcea2e81894d366f353/users/6fb881a37e3a46538ddee06f510c7fa2/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.093748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e2c-329c-4ff1-8108-a100f971cb52 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.098877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.099660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.100804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.100804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.101002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.102570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.107584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857b83406e874fcea2e81894d366f353, user_id=6fb881a37e3a46538ddee06f510c7fa2, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.110351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95098153-ea89-4883-b5c6-b1f672698341 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.112051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 817/1599] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.112923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.125570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 783/1600] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/857b83406e874fcea2e81894d366f353/users/6fb881a37e3a46538ddee06f510c7fa2/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.125920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a2d19-1e62-4a75-8421-e0a0b9990f12 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.130882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.131680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.132014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.149321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.150513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.181565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.182256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.182533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.182800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.183510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.185178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.194572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 818/1601] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.195364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.206610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74bb8-dfff-4985-87f2-25d9771a2903 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.208598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 784/1602] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.209443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.212739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.213402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.213683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.213956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.214671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.216435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.219217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d6d3-a9b5-4434-af7a-2dc94e2758cc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.224242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.224927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.225203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.225628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.226350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.230535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 819/1603] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.230695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.230832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.241047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 785/1604] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.241047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.241310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ce51b-aa34-4142-8bf1-44217427de7e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.244978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.245915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.246316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.246654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] PATH_INFO: `/v3/projects/749ebc772f1f430aa53f12ee575e0bf8/users/88941d165fcc4d1f8c22186e34c2deb2/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.249062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749ebc772f1f430aa53f12ee575e0bf8, user_id=88941d165fcc4d1f8c22186e34c2deb2, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.250477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a29e7b-1d71-4539-af5c-bc0048daf1c1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.252093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.255574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.256229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.256512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.256815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.257548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.259128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268f2f0-fdef-430f-91f7-227227c7d841 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.265263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 820/1605] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/749ebc772f1f430aa53f12ee575e0bf8/users/88941d165fcc4d1f8c22186e34c2deb2/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.266245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.272848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 786/1606] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:04.272848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.272848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.272848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.289871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.291076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.332200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6c5a-1a6f-44be-b166-f6e9e428a1a6 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.337197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.338072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.338349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.338619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] PATH_INFO: `/v3/projects/3b9de19281a345d68ed44ee426b54f79/users/f82a133b3e08451d9aaa006fd76f1e28/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.348317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 787/1607] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.350607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.353938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9de19281a345d68ed44ee426b54f79, user_id=f82a133b3e08451d9aaa006fd76f1e28, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.356589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.358041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40b17-396f-46df-812b-06c10dc18b9f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.366150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.367127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.367411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.367820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] PATH_INFO: `/v3/projects/d2279255bed8483c82ba27a2451313fc/users/6dac5d7569d4402ca9c910ea8862b5d9/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.371614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 821/1608] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/3b9de19281a345d68ed44ee426b54f79/users/f82a133b3e08451d9aaa006fd76f1e28/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.372423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.383038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.384613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2279255bed8483c82ba27a2451313fc, user_id=6dac5d7569d4402ca9c910ea8862b5d9, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.387304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.400912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 788/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/d2279255bed8483c82ba27a2451313fc/users/6dac5d7569d4402ca9c910ea8862b5d9/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.401698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.439414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267828f2-2de2-4ec8-9af7-0029847c3435 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.464114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6ef7a-d460-4b20-8f82-3a64f6c5590a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.468665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.469561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.469836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.470100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] PATH_INFO: `/v3/projects/5d958793e0ab4e6f8d2f296dcf6186f5/users/314a5e1a357c4a73a33391b6f25a44c6/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.484451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d958793e0ab4e6f8d2f296dcf6186f5, user_id=314a5e1a357c4a73a33391b6f25a44c6, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.486454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.487221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.487465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.487683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.488073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.497921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.499411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.506318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 789/1610] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/5d958793e0ab4e6f8d2f296dcf6186f5/users/314a5e1a357c4a73a33391b6f25a44c6/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.507168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.513363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 822/1611] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:04.514515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.524688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609c12-c324-4999-982d-4574b40f63bd service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.577388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53339fac-1af5-4e3c-a34d-b84bf8168b44 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.584447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.584914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.585473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.585874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.586085 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.586362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] PATH_INFO: `/v3/projects/19e49c6119e846f4868567b0e9ec5950/users/713b49f149db41c7a617834720661c37/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.586501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.586876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] PATH_INFO: `/v3/projects/5a2376b2c653467b885e8f3deb5018e7/users/775d3d61ab8d42c3a528028592ad71f8/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.603686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e49c6119e846f4868567b0e9ec5950, user_id=713b49f149db41c7a617834720661c37, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.603938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2376b2c653467b885e8f3deb5018e7, user_id=775d3d61ab8d42c3a528028592ad71f8, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.606493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f7775-e662-40d6-9b0a-29bd68bba45d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.606819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.620028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 823/1612] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/5a2376b2c653467b885e8f3deb5018e7/users/775d3d61ab8d42c3a528028592ad71f8/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.623786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fae00e-6cf8-4e2a-88a7-5854c35e26ab None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.623786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fae00e-6cf8-4e2a-88a7-5854c35e26ab None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.623786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fae00e-6cf8-4e2a-88a7-5854c35e26ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.625976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 790/1613] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:04 2022] PUT /identity/v3/projects/19e49c6119e846f4868567b0e9ec5950/users/713b49f149db41c7a617834720661c37/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:04.627125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.651638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c1fae00e-6cf8-4e2a-88a7-5854c35e26ab None None] MFA Rules not processed for user `88941d165fcc4d1f8c22186e34c2deb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.652983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c1fae00e-6cf8-4e2a-88a7-5854c35e26ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.711261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff02793-c269-4f98-a0ef-dce44730acde admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.716059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.717842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.718128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.718581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.728108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 824/1614] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.729648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55d2c-f95c-456b-a33f-13f487f13067 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.729947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55d2c-f95c-456b-a33f-13f487f13067 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.730230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55d2c-f95c-456b-a33f-13f487f13067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.761346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d4d55d2c-f95c-456b-a33f-13f487f13067 None None] MFA Rules not processed for user `f82a133b3e08451d9aaa006fd76f1e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.762599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d4d55d2c-f95c-456b-a33f-13f487f13067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.790770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.792493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45a90-3ab0-4fc0-9ab6-d3782027807f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.805378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 791/1615] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:04.806860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf861b2-0b5d-41eb-8371-5abdc53128ff None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.807249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf861b2-0b5d-41eb-8371-5abdc53128ff None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.807640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf861b2-0b5d-41eb-8371-5abdc53128ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.826225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0bf861b2-0b5d-41eb-8371-5abdc53128ff None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.827442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0bf861b2-0b5d-41eb-8371-5abdc53128ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.836844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 792/1616] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.837925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cdcd8-a740-4f17-8d6a-f84e13f1766c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.838213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cdcd8-a740-4f17-8d6a-f84e13f1766c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.838491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cdcd8-a740-4f17-8d6a-f84e13f1766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.842232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 825/1617] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.844693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.845309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.845309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.861914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4a1cdcd8-a740-4f17-8d6a-f84e13f1766c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.863522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4a1cdcd8-a740-4f17-8d6a-f84e13f1766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.867010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.868255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.876296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 793/1618] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.877844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.878254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.878536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.880377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 826/1619] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:04.882165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:04.915618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] MFA Rules not processed for user `713b49f149db41c7a617834720661c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:04.916870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:04.954598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40981f-9fc1-46e6-9d87-1a332558ceb3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:04.962560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:04.963339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:04.963699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:04.963983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:04.977724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:04.980202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:04.997224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 827/1620] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:04.998926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.017899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453061c-8fca-41dd-9f62-681004223959 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.032890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.034292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 794/1621] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:05.036319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.044577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.044913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.045113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.048274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.060691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.086906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10913cc-0acc-4f46-a7bc-5e2d9a4b2415 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.096891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.098892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.099294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.099926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.102536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 828/1622] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:04 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:05.106475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.113342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.115433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.128112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 795/1623] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:05.130198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.139999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f9f5-02bf-4ab1-a34b-a6003e2e947d service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.179702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045697e-b6e1-4f37-8e7d-2bc0748d5443 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.183577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.184245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.184522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.184852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.214324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.214324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.214324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.214324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.301903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.304137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae47c-1038-4f3a-9eb5-1db685ae527d service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.316008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 829/1624] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:05.318101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79e0c-f9bb-4fbd-83b6-e58b6d4ef01b None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.318392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79e0c-f9bb-4fbd-83b6-e58b6d4ef01b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.318673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79e0c-f9bb-4fbd-83b6-e58b6d4ef01b None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.320251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 830/1625] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 10 03:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:05.321067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79e0c-f9bb-4fbd-83b6-e58b6d4ef01b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.330079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.331854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.335547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79e0c-f9bb-4fbd-83b6-e58b6d4ef01b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.344175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.345035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.345342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.345658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.346361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.349012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec8dc-612d-411f-acf0-2a84ee0e2db5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.351035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 796/1626] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:05.351978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.362701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0ced-5777-449e-aeb6-7bb4ba99da27 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.368726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.369897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.370180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.370458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] PATH_INFO: `/v3/users/7c8ac27fbc6e45559663ebc748fec84b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.371741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8ac27fbc6e45559663ebc748fec84b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.372847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:05.372847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 10 03:14:05.372847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: May 10 03:14:05.374232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.377137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 831/1627] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:05 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:05.378545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.378840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.379120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.402622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:05.404345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:05.470093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8ac27fbc6e45559663ebc748fec84b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:05.479124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8ac27fbc6e45559663ebc748fec84b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:05.492388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8ac27fbc6e45559663ebc748fec84b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:05.493215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8ac27fbc6e45559663ebc748fec84b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:05.494052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8ac27fbc6e45559663ebc748fec84b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:05.500399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 832/1628] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 10 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:05.501086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.502650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:05.519211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd78982-3eac-4969-b69b-ee6000d64f6e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.527348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.528020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.528463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.528738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.529491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.531100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d24349-d4c2-4d0b-a610-c600986a6b0c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.535287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 797/1629] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:05 2022] DELETE /identity/v3/users/7c8ac27fbc6e45559663ebc748fec84b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:05.536893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.544377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 833/1630] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:05.546045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.546342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.546606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.567225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:05.568574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:05.636410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28062c0-fe0c-4493-9669-41903c3e2156 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.643599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.644516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.645660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.646283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.646756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 834/1631] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:05.647741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.648996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:05.666199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd779ec-9d5a-4102-add3-50c683746fcf None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.675999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.676968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.677576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.677876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.678611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.680371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.695782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 835/1632] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:05.696696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.699404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:05.760383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.762637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.777756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 798/1633] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:05.779577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:05.786696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb8a8-94da-456d-8366-f1af105e4a2f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.791740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.792455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.793421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.794387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.804377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eacef-d55d-40aa-960f-5a0b88c5afec service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:05.808933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.810841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea06aac-8a46-4d1d-94f1-4ef52940a5c3 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.821333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:05.822461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.822748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.823030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] PATH_INFO: `/v3/projects/143ec3884d4244ad91d4576e7fe375d0/users/8275423cf2bb49319769ef6434638746/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.825386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 836/1634] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:05.859370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143ec3884d4244ad91d4576e7fe375d0, user_id=8275423cf2bb49319769ef6434638746, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:05.863529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:05.891479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 799/1635] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:05 2022] PUT /identity/v3/projects/143ec3884d4244ad91d4576e7fe375d0/users/8275423cf2bb49319769ef6434638746/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:05.902998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:05.903520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:05.903951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:05.944218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] MFA Rules not processed for user `8275423cf2bb49319769ef6434638746`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:05.946235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:06.108340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 837/1636] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:06.109088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.219389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9420bf-04af-431b-b364-3de66fd67685 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.229070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.230138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.230912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.231535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.232914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.235689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf8c5-a87e-4348-86ff-095928ba619d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.311735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.321917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 800/1637] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:06 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:06.325792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae5d4-9236-433f-9743-3fd8e43705e1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.405992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814abdf-ae32-4bf8-b495-35d20b51ddc7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.406811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814abdf-ae32-4bf8-b495-35d20b51ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.407575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814abdf-ae32-4bf8-b495-35d20b51ddc7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.410180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 801/1638] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 10 03:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:06.417222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.417810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.418148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.470369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:06.470629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.471129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.471409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.471686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.472303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:06.472419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.474708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.503103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 838/1639] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:06 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:14:06.507128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.534901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120818-4cad-427f-b92e-b35bee52d153 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.547668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.549816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.550097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.552682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.557069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.563140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.591958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 839/1640] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:06.593945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.617347 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a72d-d3d5-45a0-8da0-0afabfdba45c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.631478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.634801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.635405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.636199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] PATH_INFO: `/v3/projects/0f005a7a60544d96baec7d8056ade803/users/d7163e8878834b16b80c2ab1947831c9/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.679439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f005a7a60544d96baec7d8056ade803, user_id=d7163e8878834b16b80c2ab1947831c9, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.689525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 802/1641] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:14:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:06.697120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.702231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.704302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:06.736785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 840/1642] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:06 2022] PUT /identity/v3/projects/0f005a7a60544d96baec7d8056ade803/users/d7163e8878834b16b80c2ab1947831c9/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:06.738464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.838050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761713c5-a88c-460e-a9ca-31c126044d4a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.855048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b734d-68f5-47f3-9372-ee6be0412189 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.863290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.865157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.865631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.866044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.866853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.868572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.889940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 841/1643] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:06.891861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:06.903954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ee9b0-8c09-49f4-b491-9759aa1176e6 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:06.911839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.912598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:06.913269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.913649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.913858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.914234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] PATH_INFO: `/v3/projects/0f005a7a60544d96baec7d8056ade803/users/d7163e8878834b16b80c2ab1947831c9/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.914382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.914798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:06.918468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f005a7a60544d96baec7d8056ade803, user_id=d7163e8878834b16b80c2ab1947831c9, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:06.922516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b42d-cedb-42b3-9d14-015b0b782b5a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:06.955326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 842/1644] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:06 2022] PUT /identity/v3/projects/0f005a7a60544d96baec7d8056ade803/users/d7163e8878834b16b80c2ab1947831c9/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:06.960751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f207df-d6be-4b43-b9ef-ca499085fb54 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:06.962486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f207df-d6be-4b43-b9ef-ca499085fb54 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:06.963939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f207df-d6be-4b43-b9ef-ca499085fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.052645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-40f207df-d6be-4b43-b9ef-ca499085fb54 None None] MFA Rules not processed for user `d7163e8878834b16b80c2ab1947831c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:07.054849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-40f207df-d6be-4b43-b9ef-ca499085fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.067981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:07.070118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:07.099489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 803/1645] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:07.220765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 843/1646] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:07.237038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:07.242119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.269357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c76b4-08ed-4fc1-bce4-54e112da1545 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:07.314794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:07.315310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:07.315420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.372815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:07.373323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:07.373593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:07.375762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] MFA Rules not processed for user `6fb881a37e3a46538ddee06f510c7fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:07.381329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.382046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.413244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:07.414746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:07.455539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 804/1647] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:07.475282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:07.480463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.641813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 844/1648] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:07.642721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:07.694253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea71f3-632f-4435-96e6-049ca08aaabe None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:07.710104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:07.711735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:07.713083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:07.715185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.719197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.719869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dca40-4bc2-4a36-9566-4b18264b4ae1 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:07.728529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:07.730040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:07.730430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:07.731380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] PATH_INFO: `/v3/projects/a691e60592ef4e128588ccd917030306` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.733316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a691e60592ef4e128588ccd917030306)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:07.735880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:07.841297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:07.843253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc7a4-c6b7-4400-bf22-3a9a0733541f service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:07.867667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a691e60592ef4e128588ccd917030306', 'request_id': 'req-34a882b4-d493-4d26-afcb-04a45f9e117b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:07.881504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a691e60592ef4e128588ccd917030306', 'request_id': 'req-34a882b4-d493-4d26-afcb-04a45f9e117b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:07.888883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 845/1649] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:07.895299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242f3c-053a-4f0c-afd1-d5462869442a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:07.897959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242f3c-053a-4f0c-afd1-d5462869442a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:07.898741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242f3c-053a-4f0c-afd1-d5462869442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:07.906316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a691e60592ef4e128588ccd917030306', 'request_id': 'req-34a882b4-d493-4d26-afcb-04a45f9e117b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:07.930132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] The token cache is being invalidate because project a691e60592ef4e128588ccd917030306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:07.930433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:07.932391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:07.936767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 805/1650] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:07 2022] DELETE /identity/v3/projects/a691e60592ef4e128588ccd917030306 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:07.942647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:07.945838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:07.963055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-22242f3c-053a-4f0c-afd1-d5462869442a None None] MFA Rules not processed for user `6fb881a37e3a46538ddee06f510c7fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:07.967569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-22242f3c-053a-4f0c-afd1-d5462869442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:08.163579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 846/1651] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:08.190443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1297-07df-40a3-b6db-b8ca216f7fe6 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:08.190779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1297-07df-40a3-b6db-b8ca216f7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:08.192484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1297-07df-40a3-b6db-b8ca216f7fe6 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:08.194217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 847/1652] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 10 03:14:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:08.209806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a882b4-d493-4d26-afcb-04a45f9e117b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:08.225409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:08.227042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:08.227385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:08.227668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] PATH_INFO: `/v3/users/88941d165fcc4d1f8c22186e34c2deb2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:08.230654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d254-ff69-4b22-87c7-28faf069d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:08.230945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d254-ff69-4b22-87c7-28faf069d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:08.231260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d254-ff69-4b22-87c7-28faf069d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:08.243475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88941d165fcc4d1f8c22186e34c2deb2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:08.245668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:08.289627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5219d254-ff69-4b22-87c7-28faf069d6a1 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:08.291004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5219d254-ff69-4b22-87c7-28faf069d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:08.430392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88941d165fcc4d1f8c22186e34c2deb2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:08.454542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88941d165fcc4d1f8c22186e34c2deb2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:08.480210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88941d165fcc4d1f8c22186e34c2deb2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:08.483232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88941d165fcc4d1f8c22186e34c2deb2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:08.485318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88941d165fcc4d1f8c22186e34c2deb2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:08.548583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 806/1653] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:07 2022] DELETE /identity/v3/users/88941d165fcc4d1f8c22186e34c2deb2 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:08.561022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 848/1654] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 10 03:14:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:08.571022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:08.679474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7387f4-43fb-4166-93cd-0f0dbacf503d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:08.687169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:08.688163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:08.689119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:08.689405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:08.692832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:08.774617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:08.778968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666e3c6-02e1-4fb4-90d6-137bb72888ae service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:08.796381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 807/1655] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:09.267397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:09.268067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:09.268067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:09.269563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 849/1656] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 10 03:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:09.276643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c3250-9d76-4a69-8045-9d61f7a197c3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:09.277189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c3250-9d76-4a69-8045-9d61f7a197c3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:09.277420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c3250-9d76-4a69-8045-9d61f7a197c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:09.298658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-873c3250-9d76-4a69-8045-9d61f7a197c3 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:09.300168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-873c3250-9d76-4a69-8045-9d61f7a197c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:09.317248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 808/1657] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:09.325513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:09.328371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:09.411634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380425b3-ec32-4e7a-a735-8f3ee970bdec None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:09.422775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:09.423818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:09.424252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:09.424704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:09.437822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:09.440129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45a1c6-5d1e-4d49-a444-8c603bff9e6f service glance] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:09.461601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 850/1658] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:10.178768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.179191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.179544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.181177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 809/1659] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 10 03:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:10.196175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.196175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.196175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.206386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:10.209506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:10.266273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:10.267662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:10.349196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04f133-bfdd-42f4-b9ce-6bc875561226 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:10.362849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:10.363930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.364631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.364762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] PATH_INFO: `/v3/projects/749ebc772f1f430aa53f12ee575e0bf8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.376448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749ebc772f1f430aa53f12ee575e0bf8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:10.379191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:10.382368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 851/1660] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:10.404002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:10.405733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:10.429408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16cc16-e52c-4ea7-8a04-e7bc89f85846 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:10.438522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:10.440851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.445215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.445215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.469319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:10.473705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bff4a-ca01-474a-8fc1-f9efd93b973f service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:10.489898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 852/1661] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:10.499250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749ebc772f1f430aa53f12ee575e0bf8', 'request_id': 'req-0387f38f-41d7-463f-93d8-06d789a79a45'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:10.506195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749ebc772f1f430aa53f12ee575e0bf8', 'request_id': 'req-0387f38f-41d7-463f-93d8-06d789a79a45'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:10.518934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749ebc772f1f430aa53f12ee575e0bf8', 'request_id': 'req-0387f38f-41d7-463f-93d8-06d789a79a45'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:10.540450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] The token cache is being invalidate because project 749ebc772f1f430aa53f12ee575e0bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:10.540898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:10.542205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0387f38f-41d7-463f-93d8-06d789a79a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:10.544145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 810/1662] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:10 2022] DELETE /identity/v3/projects/749ebc772f1f430aa53f12ee575e0bf8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:10.549209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.549493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.549997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.572714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:10.574070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:10.660543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 853/1663] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:10.662994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.663332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.663574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.698502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:10.709304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:10.734761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 811/1664] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:10.735941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:10.749327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750d87-325a-49c0-b41f-552bdbe9e3c8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:10.759351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:10.763285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.764196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.764780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.771417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:10.773689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:10.776852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:10.812496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 854/1665] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:10.819227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:10.831025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bf620-2c89-4311-8903-446fc47854e4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:10.843867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:10.844970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:10.845652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:10.846155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:10.847093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:10.850809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:10.922844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 812/1666] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:10 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:10.923130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:10.955637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd85a-cf33-4b4c-89be-0a58ed9134ef admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:11.102083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:11.103469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.106730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.107459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.108374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:11.110712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:11.143561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 855/1667] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:10 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:14:11.148181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:11.164706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712d82-fa9d-426e-8978-93447024801c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:11.175533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:11.176918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.177045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.177306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.178046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:11.179645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:11.217010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 813/1668] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:11.218630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:11.247960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9cd8-1859-4d80-8237-0f8e0f74d29f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:11.256444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:11.258084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.258893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.259367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.260290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:11.262430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabcbee-1c3e-4736-81b9-f4cb5828231d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:11.281759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 856/1669] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:11.282644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:11.299117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583ea62-af7a-484e-94c2-c8bdf36ff212 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:11.314286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:11.315508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.315954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.316403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] PATH_INFO: `/v3/projects/226199afcdf44517908a60888f5815a7/users/54a9807d7f3f4e0a9b16355a6fa0a326/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.350599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=226199afcdf44517908a60888f5815a7, user_id=54a9807d7f3f4e0a9b16355a6fa0a326, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:11.355291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2242c-bcb9-4939-8a95-7fbeb072f7cb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:11.387719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 814/1670] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:11 2022] PUT /identity/v3/projects/226199afcdf44517908a60888f5815a7/users/54a9807d7f3f4e0a9b16355a6fa0a326/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:11.394911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec982-deb1-4127-9281-8da675953478 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.395216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec982-deb1-4127-9281-8da675953478 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.397426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec982-deb1-4127-9281-8da675953478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.438715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ebaec982-deb1-4127-9281-8da675953478 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:11.443886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ebaec982-deb1-4127-9281-8da675953478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:11.593209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064e47-a724-4ee7-8d51-ba4e8005e090 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.593705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064e47-a724-4ee7-8d51-ba4e8005e090 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.594218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064e47-a724-4ee7-8d51-ba4e8005e090 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.596636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 815/1671] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 10 03:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:11.602297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.602757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.603195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.620353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 857/1672] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:11.651845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] MFA Rules not processed for user `614c1bd3422341358ed13584bfb24439`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:11.653141 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:11.804582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 816/1673] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 10 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:11.813673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaec982-deb1-4127-9281-8da675953478 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:11.828781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaec982-deb1-4127-9281-8da675953478 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:11.851033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:11.853800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:11.854230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:11.855871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:11.860916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:11.895548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:11.897235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:11.934376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 858/1674] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:11.979499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:11.984175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:12.186298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83c81-ce56-4ac2-ab19-4de0f3a546d6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:12.192737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:12.208208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:12.208579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:12.208900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:12.249068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:12.250328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba911e-68a6-490e-9fad-d005e17a05bc service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:12.271756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 817/1675] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:13.479131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:13.480891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:13.522678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cef4-436b-43c9-933f-bd51df400cd0 service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:13.538455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:13.539664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:13.540519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:13.540980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] PATH_INFO: `/v3/users/f82a133b3e08451d9aaa006fd76f1e28` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:13.543754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82a133b3e08451d9aaa006fd76f1e28)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:13.546283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:13.687305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82a133b3e08451d9aaa006fd76f1e28'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:13.712107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82a133b3e08451d9aaa006fd76f1e28'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:13.715091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82a133b3e08451d9aaa006fd76f1e28'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:13.738208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82a133b3e08451d9aaa006fd76f1e28'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:13.739685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82a133b3e08451d9aaa006fd76f1e28'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:13.802627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1cb1f-8a79-4065-b951-8081fee328a1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:13.806458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1cb1f-8a79-4065-b951-8081fee328a1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:13.807307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1cb1f-8a79-4065-b951-8081fee328a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:13.822211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 859/1676] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:13 2022] DELETE /identity/v3/users/f82a133b3e08451d9aaa006fd76f1e28 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:13.879605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f5f1cb1f-8a79-4065-b951-8081fee328a1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:13.881789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f5f1cb1f-8a79-4065-b951-8081fee328a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:14.037891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 818/1677] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:14.107824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:14.110829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:14.290681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726b6ee-0528-483f-b8c0-14b790ac7914 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:14.300072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:14.301608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:14.301880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:14.302153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:14.330429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:14.333742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:14.365366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 860/1678] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:15.902549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:15.903889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:15.904408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:15.949770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:15.952235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:16.176007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 819/1679] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:16.509358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:16.510989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:16.531512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:16.533723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:16.565510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fd364-e0e1-4f79-b965-665f45c7bce7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:16.576312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:16.577581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:16.578184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:16.578767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] PATH_INFO: `/v3/users/713b49f149db41c7a617834720661c37` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:16.583969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713b49f149db41c7a617834720661c37)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:16.586591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:16.673177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d77a-59c1-4d1d-a051-e2e0cfca471a service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:16.681449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:16.682838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:16.683711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:16.685193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:16.708005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713b49f149db41c7a617834720661c37'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:16.710797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:16.712718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bc113-d773-4cdc-9638-fe1559f7c6a3 service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:16.730021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713b49f149db41c7a617834720661c37'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:16.749395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 861/1680] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:14:16.749512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713b49f149db41c7a617834720661c37'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:16.753085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713b49f149db41c7a617834720661c37'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:16.754303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713b49f149db41c7a617834720661c37'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:16.795553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 820/1681] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:16 2022] DELETE /identity/v3/users/713b49f149db41c7a617834720661c37 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:16.804443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:16.806025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:16.806614 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:16.849007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:16.850160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:17.145277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 862/1682] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:17.178842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:17.180521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:17.412857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300445b-615a-4592-ac17-91ec9880b584 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:17.436742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:17.439434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:17.440886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:17.442822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:17.491951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:17.496782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:17.557670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 821/1683] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:18.203611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:18.206441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:18.227010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e11a-a2ec-49e7-aad6-63f6d9d0a3fb None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:18.241999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:18.243250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:18.243876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:18.244393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] PATH_INFO: `/v3/projects/3b9de19281a345d68ed44ee426b54f79` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:18.252167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9de19281a345d68ed44ee426b54f79)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:18.253618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: WARNING py.warnings [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:14:18.253618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: warnings.warn(msg) May 10 03:14:18.253618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: May 10 03:14:18.255851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:18.390074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9de19281a345d68ed44ee426b54f79', 'request_id': 'req-fee57bf8-3633-4f89-9201-d21e1feafe23'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.412023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9de19281a345d68ed44ee426b54f79', 'request_id': 'req-fee57bf8-3633-4f89-9201-d21e1feafe23'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.428243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9de19281a345d68ed44ee426b54f79', 'request_id': 'req-fee57bf8-3633-4f89-9201-d21e1feafe23'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.674836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] The token cache is being invalidate because project 3b9de19281a345d68ed44ee426b54f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:18.675125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.676417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-fee57bf8-3633-4f89-9201-d21e1feafe23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.681106 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 863/1684] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:18 2022] DELETE /identity/v3/projects/3b9de19281a345d68ed44ee426b54f79 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:18.682244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:18.696747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be6ed-6afe-4cdb-9f75-ec836026ffaa service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:18.777704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:18.779273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:18.779753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:18.780215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] PATH_INFO: `/v3/users/8275423cf2bb49319769ef6434638746` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:18.782327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8275423cf2bb49319769ef6434638746)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:18.785878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:18.876116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8275423cf2bb49319769ef6434638746'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.897367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8275423cf2bb49319769ef6434638746'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.915246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8275423cf2bb49319769ef6434638746'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.917064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8275423cf2bb49319769ef6434638746'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.919227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8275423cf2bb49319769ef6434638746'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:18.978947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 822/1685] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:18 2022] DELETE /identity/v3/users/8275423cf2bb49319769ef6434638746 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:19.113013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:19.114226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:19.114628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:19.182961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] MFA Rules not processed for user `54a9807d7f3f4e0a9b16355a6fa0a326`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:19.184869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:19.390050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 864/1686] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:19.393486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:19.396767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:19.523555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c5d-658d-4f79-be9e-527add36a495 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:19.540528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:19.541726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:19.542219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:19.543813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:19.549797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:19.555833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:19.644135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 823/1687] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:19 2022] POST /identity/v3/projects => generated 405 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:19.649493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:19.667238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c828f-0f30-4475-9f32-743f12bc1de2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:19.871600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:19.874253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:19.874957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:19.875981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:19.877596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:19.902197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:19.914747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:19.917075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:19.951778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14386-d0f2-43a2-8ae5-9e11ce7c8248 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:19.965481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 865/1688] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:19 2022] POST /identity/v3/users => generated 309 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:19.967447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:19.972004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:19.975848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:19.976143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:19.977613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] PATH_INFO: `/v3/projects/19e49c6119e846f4868567b0e9ec5950` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:19.981894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e49c6119e846f4868567b0e9ec5950)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:19.987861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.006528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e145-601d-403b-9ff4-94b708c02017 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.027258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.029467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.029749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.030026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.030769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.033525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.093072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 866/1689] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:20.095112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.135952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959a8c-2f72-4472-beff-390e42d7f824 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.140613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e49c6119e846f4868567b0e9ec5950', 'request_id': 'req-77ddd52d-f458-4953-bea0-1b1fd21219c7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.165382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e49c6119e846f4868567b0e9ec5950', 'request_id': 'req-77ddd52d-f458-4953-bea0-1b1fd21219c7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.202238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e49c6119e846f4868567b0e9ec5950', 'request_id': 'req-77ddd52d-f458-4953-bea0-1b1fd21219c7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.242571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] The token cache is being invalidate because project 19e49c6119e846f4868567b0e9ec5950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:20.244175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.245131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77ddd52d-f458-4953-bea0-1b1fd21219c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.255312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 824/1690] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:19 2022] DELETE /identity/v3/projects/19e49c6119e846f4868567b0e9ec5950 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:20.259441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecb51-6a67-4605-b7b6-32e23270e66c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.261808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecb51-6a67-4605-b7b6-32e23270e66c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.262115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecb51-6a67-4605-b7b6-32e23270e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.271846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.273591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.275801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.276309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] PATH_INFO: `/v3/projects/f809747a72f34080a796d52608c9b362/users/ec09fb399e054febb191532ef46cc282/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.317778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f809747a72f34080a796d52608c9b362, user_id=ec09fb399e054febb191532ef46cc282, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.326380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.334917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b30ecb51-6a67-4605-b7b6-32e23270e66c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:20.336447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b30ecb51-6a67-4605-b7b6-32e23270e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:20.360375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 825/1691] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:20.367602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.367958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.368348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.373140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 867/1692] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:20 2022] PUT /identity/v3/projects/f809747a72f34080a796d52608c9b362/users/ec09fb399e054febb191532ef46cc282/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:20.377730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.380242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:20.423114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:20.424502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:20.607534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb179-b200-4d13-a110-b90868e5a3cf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.633365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.634474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.634950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.635223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.635957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.637577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.662836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 826/1693] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:20.662836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.667426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:20.670568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 868/1694] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:20.675092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.701958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d44f-14e7-4eb9-97ef-deef40fc1185 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.710001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30db416-5625-46c6-9f71-2cdd620a2186 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.718440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.719016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.719389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.719711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.720449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:20.720782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.724590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.737192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.761348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.761348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.761348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] PATH_INFO: `/v3/projects/143ec3884d4244ad91d4576e7fe375d0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.764330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 869/1695] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:20.765232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.765337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143ec3884d4244ad91d4576e7fe375d0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.770235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.802711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ed533-0df7-4d20-abe4-1cdd13215e95 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:20.828963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:20.829621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:20.829939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:20.830213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] PATH_INFO: `/v3/projects/f809747a72f34080a796d52608c9b362/users/ec09fb399e054febb191532ef46cc282/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:20.845697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f809747a72f34080a796d52608c9b362, user_id=ec09fb399e054febb191532ef46cc282, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:20.860905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:20.887766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 870/1696] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:20 2022] PUT /identity/v3/projects/f809747a72f34080a796d52608c9b362/users/ec09fb399e054febb191532ef46cc282/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:20.893156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:20.964297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143ec3884d4244ad91d4576e7fe375d0', 'request_id': 'req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:20.997123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143ec3884d4244ad91d4576e7fe375d0', 'request_id': 'req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.025336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143ec3884d4244ad91d4576e7fe375d0', 'request_id': 'req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.067172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] The token cache is being invalidate because project 143ec3884d4244ad91d4576e7fe375d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:21.067396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.069704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.072617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 827/1697] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:20 2022] DELETE /identity/v3/projects/143ec3884d4244ad91d4576e7fe375d0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:21.082491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.087498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:21.126236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735bd7-77c4-4650-8d80-e2275f8e054f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.261580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.272941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.273280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.275203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.276218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.278216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.291902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e11e6-06a1-4de8-aa08-afb2c3895b28 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.307013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.307944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.308227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.308506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] PATH_INFO: `/v3/users/d7163e8878834b16b80c2ab1947831c9` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.313757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7163e8878834b16b80c2ab1947831c9)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.316009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.336316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 871/1698] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:20 2022] POST /identity/v3/projects => generated 367 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:21.341458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.344856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:21.422745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7163e8878834b16b80c2ab1947831c9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.437133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7163e8878834b16b80c2ab1947831c9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.453376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7163e8878834b16b80c2ab1947831c9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.455848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7163e8878834b16b80c2ab1947831c9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.457568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2374b70c-c3f4-4fd6-8275-b772a009254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7163e8878834b16b80c2ab1947831c9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:21.489946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f8900-cec9-4e62-8d4f-731a6ec03f3c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.496075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.497329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.497835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.498315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.499343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.501819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.510558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 828/1699] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:21 2022] DELETE /identity/v3/users/d7163e8878834b16b80c2ab1947831c9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:21.511620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.511907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.512354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.574373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 872/1700] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:21 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:21.579701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.581059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:21.582950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:21.583647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:21.637241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df569b7a-3188-4a08-8a89-60d30c307251 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.759151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 829/1701] 10.222.0.64 () {58 vars in 1015 bytes} [Tue May 10 03:14:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:21.819183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.820880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:21.838881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.840438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.841030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.841560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.842022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ae80-5c74-44c1-8778-29b8163ce6c3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.842932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.846473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.856072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.857615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.858165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.858749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.892296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 873/1702] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:21.895382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.897329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.898023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.925187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 830/1703] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:21.926796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e86c8-846b-4906-b08d-2681b85360bf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:21.934483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:21.937075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:21.937662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:21.938120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:21.939167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:21.940960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcffcf-0e9f-4b06-a783-6ab1b4d4e6f3 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:21.959052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 874/1704] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:21.963774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:21.992516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdefaf9-ad63-42a8-9b8f-5dad8ca33d5e service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:22.007822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:22.009440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:22.009889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:22.010311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] PATH_INFO: `/v3/projects/67941a20ac2d4f9aa3bb98513f2c9c6d/users/8a0bf91e5fe24da899b1729de4f268bb/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:22.042246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=67941a20ac2d4f9aa3bb98513f2c9c6d, user_id=8a0bf91e5fe24da899b1729de4f268bb, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:22.051090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:22.136942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 831/1705] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:21 2022] PUT /identity/v3/projects/67941a20ac2d4f9aa3bb98513f2c9c6d/users/8a0bf91e5fe24da899b1729de4f268bb/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:22.137683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf8a-950a-45bb-bd97-1243598d3582 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:22.138167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf8a-950a-45bb-bd97-1243598d3582 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:22.138642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf8a-950a-45bb-bd97-1243598d3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:22.235448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2b54cf8a-950a-45bb-bd97-1243598d3582 None None] MFA Rules not processed for user `8a0bf91e5fe24da899b1729de4f268bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:22.236987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2b54cf8a-950a-45bb-bd97-1243598d3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:22.419194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 875/1706] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:22.428513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:22.430876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:22.575635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03654-4dd4-43bf-973f-73413012f3eb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:22.585082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:22.586386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:22.586803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:22.587122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:22.646848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:22.661752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:22.711238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 832/1707] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:23.815154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:23.815736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:23.815736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:23.917684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] MFA Rules not processed for user `a8a3337faba84d0aa85df4121ffb5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:23.920068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:24.102606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 876/1708] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:24.118784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:24.120285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:24.325107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fe37-9908-4e46-825a-b85bb570330d service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:24.336836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:24.338670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:24.340615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:24.341020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:24.373293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:24.376874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92a056-9fd2-4448-8c20-7ac4acb8a9b6 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:24.420737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 833/1709] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:25.129751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:25.131473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:25.245904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:25.246579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:25.246579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:25.382531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] MFA Rules not processed for user `775d3d61ab8d42c3a528028592ad71f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:25.384889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:25.479654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f054-515e-4057-9997-021dc5219dac None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:25.494041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:25.498307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:25.499266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:25.500243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] PATH_INFO: `/v3/projects/0f005a7a60544d96baec7d8056ade803` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:25.510812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f005a7a60544d96baec7d8056ade803)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:25.520843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:25.752140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 834/1710] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:25.767896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:25.773745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f005a7a60544d96baec7d8056ade803', 'request_id': 'req-f440577c-d22d-48f0-9455-758a2ad595ff'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:25.803800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f005a7a60544d96baec7d8056ade803', 'request_id': 'req-f440577c-d22d-48f0-9455-758a2ad595ff'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:25.828032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c279d-42cb-4a20-afae-332c2a7ed340 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:25.839866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f005a7a60544d96baec7d8056ade803', 'request_id': 'req-f440577c-d22d-48f0-9455-758a2ad595ff'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:25.867419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] The token cache is being invalidate because project 0f005a7a60544d96baec7d8056ade803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:25.868433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:25.870757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f440577c-d22d-48f0-9455-758a2ad595ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:25.881485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 877/1711] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:25 2022] DELETE /identity/v3/projects/0f005a7a60544d96baec7d8056ade803 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:25.883313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b126ee-f879-4267-94c7-7ec8243d046a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:25.883725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b126ee-f879-4267-94c7-7ec8243d046a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:25.884073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b126ee-f879-4267-94c7-7ec8243d046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:25.929120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-93b126ee-f879-4267-94c7-7ec8243d046a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:25.930977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-93b126ee-f879-4267-94c7-7ec8243d046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:26.081314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.082028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.085754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.087167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.093303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:26.145170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 878/1712] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:26.147839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.148306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.148776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.189564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:26.191772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:26.215316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 879/1713] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:26.217290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.239649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f5e4-90f4-4939-9c8c-f5e26a03e1c7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.256147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.257090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.257534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.257960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.258840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:26.259654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.261460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.300410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 880/1714] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:26.302439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.326638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603824d-ef36-492b-a184-c2fea18beaab admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.332948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.334516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.341015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.341799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.342091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.342362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.343873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.350230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.384445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 835/1715] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:26.408666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.410253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 881/1716] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:26.457973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051d26-3792-484b-8747-ba832ebcf5e1 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.665572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.666412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.667023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.667618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.668604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.670902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.715473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 836/1717] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:26 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:26.719368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.736481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c8ec-d4c2-4820-9f8a-b45ca186e644 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.766053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.766755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.770649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.770995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.771699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.773369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.819200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.823454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 882/1718] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:26.838221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f29b8-18d1-4682-b516-5c31a0213642 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.852761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.853641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.854129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.854748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:26.855699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:26.858539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041eb116-7351-4768-b5b7-5834b687d2ab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:26.888529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 837/1719] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:26.892682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:26.933087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c72d-7896-4c81-997a-81c2d123fb71 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:26.963490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:26.967113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:26.967442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:26.967734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] PATH_INFO: `/v3/projects/346385e457354667a174f82a08dca9c6/users/cf77b9e52f954ad996deca1ed8a56072/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:27.042700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=346385e457354667a174f82a08dca9c6, user_id=cf77b9e52f954ad996deca1ed8a56072, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:27.045702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0177a4f-f243-42c5-9e28-76d27c67f45d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:27.076729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 883/1720] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:26 2022] PUT /identity/v3/projects/346385e457354667a174f82a08dca9c6/users/cf77b9e52f954ad996deca1ed8a56072/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:27.089319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:27.089717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:27.090092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:27.187295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] MFA Rules not processed for user `cf77b9e52f954ad996deca1ed8a56072`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:27.188734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:27.259038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc800-b298-4ade-b726-681ef84df32c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:27.260011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc800-b298-4ade-b726-681ef84df32c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:27.261121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc800-b298-4ade-b726-681ef84df32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:27.386104 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 838/1721] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:27.388297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:27.392205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-148cc800-b298-4ade-b726-681ef84df32c None None] MFA Rules not processed for user `314a5e1a357c4a73a33391b6f25a44c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:27.402613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-148cc800-b298-4ade-b726-681ef84df32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:27.632966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe643e-c078-4cab-aaef-f661ba4e32a8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:27.654575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:27.657089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:27.657974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:27.659032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:27.661010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:27.665231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:27.723305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 884/1722] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:27.723305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:27.723305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:27.723305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:27.758690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 839/1723] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:27 2022] POST /identity/v3/projects => generated 385 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:27.759797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:27.766059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:27.822486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] MFA Rules not processed for user `ec09fb399e054febb191532ef46cc282`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:27.823698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:28.026627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1b7e-bb63-4518-9302-26639d0e2425 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:28.049450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:28.050864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.051167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.051447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.109821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 885/1724] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:28.110200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:28.297352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:28.305020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:28.319412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edcc66-97b5-4f1b-a318-931cc8bac8a7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:28.330637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:28.332879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.335128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.335504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.336316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:28.338851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:28.358534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 840/1725] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:28.408535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 886/1726] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:28 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:28.410579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:28.433244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33041-8f25-4f7b-819c-585527fec98f service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:28.459958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:28.460805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.461084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.461819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.463220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:28.466798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:28.501627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:28.505027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 841/1727] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:14:28.520108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2646-8a8c-447e-a55a-9d109dd157f6 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:28.537947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:28.539116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.539609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.540084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] PATH_INFO: `/v3/projects/1c047737c92845ea9a967a10a1d155c8/users/52231b8699f940499b230760ba1a0cbe/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.582560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c047737c92845ea9a967a10a1d155c8, user_id=52231b8699f940499b230760ba1a0cbe, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:28.637677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6bf63-4231-4eb1-99a0-1a7491d2d396 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:28.754579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:28.756440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 887/1728] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:28 2022] PUT /identity/v3/projects/1c047737c92845ea9a967a10a1d155c8/users/52231b8699f940499b230760ba1a0cbe/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:28.764510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aed-4aa9-4eb2-b362-24a4616f4f75 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.772836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aed-4aa9-4eb2-b362-24a4616f4f75 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.776125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6742cf-74d8-47a1-beb6-bc602f6f9a21 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:28.776680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aed-4aa9-4eb2-b362-24a4616f4f75 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.794447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 888/1729] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:14:28 2022] GET /identity => generated 270 bytes in 36 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:28.964088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:28.965075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:28.965515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:28.965925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:28.966803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:28.968818 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ae592-a610-48b7-94d2-ce80bd58148f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:28.992127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 842/1730] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:14:28.993540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e8aed-4aa9-4eb2-b362-24a4616f4f75 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:29.026636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e8aed-4aa9-4eb2-b362-24a4616f4f75 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:29.057306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:29.060240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:29.065703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:29.068691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] PATH_INFO: `/v3/projects/1c047737c92845ea9a967a10a1d155c8/users/52231b8699f940499b230760ba1a0cbe/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:29.075367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c047737c92845ea9a967a10a1d155c8, user_id=52231b8699f940499b230760ba1a0cbe, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:29.089469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d15c2a-ae97-4963-a6d1-7ddd6bad354f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:29.101702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:29.102551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:29.103093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:29.160043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 889/1731] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:28 2022] PUT /identity/v3/projects/1c047737c92845ea9a967a10a1d155c8/users/52231b8699f940499b230760ba1a0cbe/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:29.173868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:29.190616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:29.192436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:29.192761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:29.203371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:29.303860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] MFA Rules not processed for user `52231b8699f940499b230760ba1a0cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:29.315079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:29.478182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 843/1732] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:29.606851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 890/1733] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:29.618632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:29.620372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:29.771897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73561d2-279d-4489-96ba-13b414e34c50 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:29.779057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:29.780280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:29.780884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:29.781315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:29.946257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:29.953428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:29.963529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:29.975695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa400a-2c9e-4009-8aed-854afd53230f service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:30.007926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294d51-b683-4b69-9d4b-c5baee77bfd7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:30.030091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 844/1734] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:30.065534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:30.066745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:30.067252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:30.067893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:30.131812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:30.134458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb33fe-1000-48a3-82f9-11ddbc2a5e81 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:30.186755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 891/1735] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:31.501340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:31.501854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:31.501854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:31.573261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] MFA Rules not processed for user `6dac5d7569d4402ca9c910ea8862b5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:31.575723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:31.792487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c511-8929-4b1b-a850-02ad0176fc42 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:31.792487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c511-8929-4b1b-a850-02ad0176fc42 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:31.793005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c511-8929-4b1b-a850-02ad0176fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:31.795176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 845/1736] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:31.846549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c891c511-8929-4b1b-a850-02ad0176fc42 None None] MFA Rules not processed for user `6dac5d7569d4402ca9c910ea8862b5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:31.852602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c891c511-8929-4b1b-a850-02ad0176fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:31.893650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 892/1737] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:31.901871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:31.925951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22766d40-3f2b-4333-87d9-3511e598fc5c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:31.944346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:31.946346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:31.948260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:31.948782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:31.979262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:31.984764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e7f26-17b3-41a5-aad8-ae1ff0ba4f72 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:32.014454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 846/1738] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:33.282713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:33.283641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:33.284116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:33.286589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 893/1739] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 10 03:14:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:33.294387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dcd52-78d5-442b-a61d-e08a6706c482 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:33.295337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dcd52-78d5-442b-a61d-e08a6706c482 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:33.295797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dcd52-78d5-442b-a61d-e08a6706c482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:33.336150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1e9dcd52-78d5-442b-a61d-e08a6706c482 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:33.341182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1e9dcd52-78d5-442b-a61d-e08a6706c482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:33.466101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 847/1740] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:14:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:33.505596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:33.507543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:33.531340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed1d12-edd6-440d-983f-df3764c2ae7f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:33.540020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:33.540801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:33.541040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:33.541292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:33.562088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:33.564903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d80ed-3330-465a-a73e-c544d884387b service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:33.593968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 894/1741] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:34.882747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:34.884170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:34.884929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:34.885375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:34.885796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:34.886269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:34.967801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] MFA Rules not processed for user `a8a3337faba84d0aa85df4121ffb5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:34.973419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] MFA Rules not processed for user `6dac5d7569d4402ca9c910ea8862b5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:34.977904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:34.979094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:34.991819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 895/1742] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:35.233519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 848/1743] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:35.849613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:35.851364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:35.892769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:35.895030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.029858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea66d0-1498-43cb-ad40-ac66042ee799 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:36.041218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:36.042102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:36.042443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:36.042637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] PATH_INFO: `/v3/users/8a0bf91e5fe24da899b1729de4f268bb` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:36.045907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0bf91e5fe24da899b1729de4f268bb)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:36.048002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:36.110703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92405-ce6c-4363-8987-5cca67ad41ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:36.134785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:36.137705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:36.138008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:36.138287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] PATH_INFO: `/v3/users/54a9807d7f3f4e0a9b16355a6fa0a326` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:36.143436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a9807d7f3f4e0a9b16355a6fa0a326)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:36.147123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:36.197466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0bf91e5fe24da899b1729de4f268bb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.222621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0bf91e5fe24da899b1729de4f268bb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.223708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0bf91e5fe24da899b1729de4f268bb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.250718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0bf91e5fe24da899b1729de4f268bb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.251448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0bf91e5fe24da899b1729de4f268bb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.297290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a9807d7f3f4e0a9b16355a6fa0a326'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.297715 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 896/1744] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:35 2022] DELETE /identity/v3/users/8a0bf91e5fe24da899b1729de4f268bb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:36.298661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:36.305128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.314960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a9807d7f3f4e0a9b16355a6fa0a326'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.344154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a9807d7f3f4e0a9b16355a6fa0a326'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.345147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a9807d7f3f4e0a9b16355a6fa0a326'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.345999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7931e93c-a6c5-4276-873a-36611800d512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a9807d7f3f4e0a9b16355a6fa0a326'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:36.394602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 849/1745] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:35 2022] DELETE /identity/v3/users/54a9807d7f3f4e0a9b16355a6fa0a326 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:36.394602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab0e7-a32c-47ac-b26c-0128844766ed None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:36.394602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab0e7-a32c-47ac-b26c-0128844766ed None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:36.394602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab0e7-a32c-47ac-b26c-0128844766ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:36.417096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3adab0e7-a32c-47ac-b26c-0128844766ed None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:36.418443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3adab0e7-a32c-47ac-b26c-0128844766ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.488296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119874-680c-4175-a2a7-30e5d5ff8971 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:36.625351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 850/1746] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:36.637099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:36.637399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:36.637678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:36.668375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:36.669389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:36.669682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:36.669968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:36.674586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.695924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] MFA Rules not processed for user `775d3d61ab8d42c3a528028592ad71f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:36.699066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.837716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:36.839813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:36.856752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 851/1747] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:36.858467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:36.861210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:36.870738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 897/1748] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:36.991826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:36.993438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:37.028845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551392eb-af1d-4891-9067-bbd2613aff6e service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:37.076049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:37.077787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:37.078990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b562e8-f2c2-4955-b36a-b111593a9338 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:37.080978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:37.082456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] PATH_INFO: `/v3/projects/226199afcdf44517908a60888f5815a7` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:37.087617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226199afcdf44517908a60888f5815a7)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:37.093693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:37.113710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:37.114665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:37.120937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:37.121557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:37.162631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:37.166306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:37.224762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 852/1749] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:37.248210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226199afcdf44517908a60888f5815a7', 'request_id': 'req-48a7bceb-2222-4622-b70d-1629bbd419d5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.281784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226199afcdf44517908a60888f5815a7', 'request_id': 'req-48a7bceb-2222-4622-b70d-1629bbd419d5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.302925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226199afcdf44517908a60888f5815a7', 'request_id': 'req-48a7bceb-2222-4622-b70d-1629bbd419d5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.331314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] The token cache is being invalidate because project 226199afcdf44517908a60888f5815a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:37.331605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.337144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-48a7bceb-2222-4622-b70d-1629bbd419d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.344258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:37.344800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 898/1750] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:36 2022] DELETE /identity/v3/projects/226199afcdf44517908a60888f5815a7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:37.354147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacac8-19c8-4630-9248-3a7f652e0444 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:37.512725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:37.513735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:37.514034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:37.515057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] PATH_INFO: `/v3/users/ec09fb399e054febb191532ef46cc282` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:37.517823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec09fb399e054febb191532ef46cc282)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:37.527614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:37.645710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b3da-1ad2-4d9e-a02d-b1f20d676216 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:37.645998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b3da-1ad2-4d9e-a02d-b1f20d676216 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:37.646272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b3da-1ad2-4d9e-a02d-b1f20d676216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:37.735683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec09fb399e054febb191532ef46cc282'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.746385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5955b3da-1ad2-4d9e-a02d-b1f20d676216 None None] MFA Rules not processed for user `314a5e1a357c4a73a33391b6f25a44c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:37.750339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5955b3da-1ad2-4d9e-a02d-b1f20d676216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:37.761912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec09fb399e054febb191532ef46cc282'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.802293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec09fb399e054febb191532ef46cc282'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.821175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec09fb399e054febb191532ef46cc282'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.827385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec09fb399e054febb191532ef46cc282'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:37.902070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 853/1751] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:37 2022] DELETE /identity/v3/users/ec09fb399e054febb191532ef46cc282 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:37.946469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 899/1752] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:38.424067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:38.426781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:38.556340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c07d8-b8aa-4036-a62f-ee2e77a94e4a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:38.562626 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:38.563586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:38.563892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:38.564171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] PATH_INFO: `/v3/projects/67941a20ac2d4f9aa3bb98513f2c9c6d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:38.567706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] RBAC: Authorizing `identity:delete_project(project_id=67941a20ac2d4f9aa3bb98513f2c9c6d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:38.569931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:38.671702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67941a20ac2d4f9aa3bb98513f2c9c6d', 'request_id': 'req-d8e262a0-8935-4cea-805a-52020ea0edde'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:38.678265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67941a20ac2d4f9aa3bb98513f2c9c6d', 'request_id': 'req-d8e262a0-8935-4cea-805a-52020ea0edde'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:38.704951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67941a20ac2d4f9aa3bb98513f2c9c6d', 'request_id': 'req-d8e262a0-8935-4cea-805a-52020ea0edde'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:38.729088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] The token cache is being invalidate because project 67941a20ac2d4f9aa3bb98513f2c9c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:38.729214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:38.730901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:38.733024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 854/1753] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:38 2022] DELETE /identity/v3/projects/67941a20ac2d4f9aa3bb98513f2c9c6d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:38.737842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3fa0-8739-49f6-a88c-a7c8d64b4068 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:38.738376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3fa0-8739-49f6-a88c-a7c8d64b4068 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:38.738553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3fa0-8739-49f6-a88c-a7c8d64b4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:38.790882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fb3b3fa0-8739-49f6-a88c-a7c8d64b4068 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:38.793297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fb3b3fa0-8739-49f6-a88c-a7c8d64b4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:38.870268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:38.871867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:38.988218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 900/1754] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:38.992971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:38.994049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:38.994482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.053446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:39.075164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:39.104329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e262a0-8935-4cea-805a-52020ea0edde admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.105966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 901/1755] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:39.109120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.126317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.127271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.127561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.127837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] PATH_INFO: `/v3/projects/f809747a72f34080a796d52608c9b362` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.130336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f809747a72f34080a796d52608c9b362)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.132287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:39.151193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eea39-c8b5-4b9c-8e3f-b368ef0d94a5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.178303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.184246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.184539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.185797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.188241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:39.189219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.203930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:39.271270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 902/1756] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:39.281344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.331060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c631-ec70-40f0-84cb-4d1650263456 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.334597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f809747a72f34080a796d52608c9b362', 'request_id': 'req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:39.341771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f809747a72f34080a796d52608c9b362', 'request_id': 'req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:39.352700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f809747a72f34080a796d52608c9b362', 'request_id': 'req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:39.368835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] The token cache is being invalidate because project f809747a72f34080a796d52608c9b362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:39.369962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:39.370834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e9ff397c-9a67-4603-bcb3-7bff4a4b6ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:39.372948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 855/1757] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:38 2022] DELETE /identity/v3/projects/f809747a72f34080a796d52608c9b362 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:39.379031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf222a-f21c-4337-8b2b-7395cb4247f8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.379506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf222a-f21c-4337-8b2b-7395cb4247f8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.380194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf222a-f21c-4337-8b2b-7395cb4247f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.405672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8ecf222a-f21c-4337-8b2b-7395cb4247f8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:39.407607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8ecf222a-f21c-4337-8b2b-7395cb4247f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:39.520991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.524538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.525627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.529408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.532098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.542690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:39.600665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 903/1758] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:39 2022] POST /identity/v3/projects => generated 387 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:39.604363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.608778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:39.613386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 856/1759] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:39.623915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.624970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.625400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.684167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:39.684167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:39.799505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84e7f-3de0-4c1d-aefc-18fb5c67edaf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.807547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.808618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.809862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.810377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.812223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.814528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:39.856172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 857/1760] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:39.870808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.889931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba66f2-4132-40b4-9300-9169d61145b3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.895108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 904/1761] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:39 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:39.896054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.896360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.897482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.897855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.898000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.898986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:39.899358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.901603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:39.930617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 858/1762] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:39.934175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:39.957108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f1e2-b8fd-47c0-98da-7af6ea5e5e31 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.965922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db2ae4-f684-406c-94a3-f536fcef1a4b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:39.983986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.984292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.984574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.984869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.985570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.986570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:39.989889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:39.990196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:39.990472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:39.991225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:39.992880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.005249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.039478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 905/1763] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:40.042275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.069570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bd57-b0d1-4e7f-a5f2-aec510d68bee admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.080780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.081537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.083043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.083482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.084735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.086865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.106195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 906/1764] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:40.107623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.124152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 859/1765] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:40.127794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.138846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4be0a-16cb-4b6f-8e75-fb4cc1ef8c57 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.241385 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.244371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1090d-bb5c-4086-a000-76297ee8bf53 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.252756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.254068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.254398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] PATH_INFO: `/v3/projects/8d7227129019467e9d6e6feb5591b698/users/50af923de7bb4ec58a0a691ece4a36a2/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.259773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.261032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.261543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.263854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.266033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.268219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.295007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7227129019467e9d6e6feb5591b698, user_id=50af923de7bb4ec58a0a691ece4a36a2, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.297472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 860/1766] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:14:40.299120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409d1b-0c53-4f01-83ff-2b63280b1081 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.304963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.316559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f02c9-7444-4aac-abf0-707d4bcd2641 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.328173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 907/1767] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:40 2022] PUT /identity/v3/projects/8d7227129019467e9d6e6feb5591b698/users/50af923de7bb4ec58a0a691ece4a36a2/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:40.341336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.341662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.341895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.388264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] MFA Rules not processed for user `50af923de7bb4ec58a0a691ece4a36a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:40.389575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:40.423927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.425030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.425826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.426302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.427195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.429018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.442209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 861/1768] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:40.445876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.459657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee0bd-41c1-4574-8bd9-cc0b4f010262 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.467799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.469106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.469963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.471416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.473864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.477684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.495539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 862/1769] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:40.498847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.537475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d1f4-8d52-4bd9-8d01-64bc3d337d3e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.545097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.548713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.549790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.550037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] PATH_INFO: `/v3/projects/7f62874fd03d42e794afb7825d9ccd18/users/85df3b8c89f741c598ba34afa6467445/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.571748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f62874fd03d42e794afb7825d9ccd18, user_id=85df3b8c89f741c598ba34afa6467445, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.574933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f8195-7c90-41a7-942a-7f3d8556582a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.598327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 863/1770] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:40 2022] PUT /identity/v3/projects/7f62874fd03d42e794afb7825d9ccd18/users/85df3b8c89f741c598ba34afa6467445/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:40.609724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.610155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.611813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.648581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 908/1771] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:40.649991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.659484 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] MFA Rules not processed for user `85df3b8c89f741c598ba34afa6467445`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:40.661202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:40.704266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578dbc2-078b-4b43-9cd0-d44475e3fd06 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.853610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.854435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.854618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.854895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.855657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.857706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.882543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 864/1772] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:40.897652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:40.929347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d58e09-7ecc-4ce2-852b-a6035a9f64c8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:40.937994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:40.938823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:40.940490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:40.941059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:40.944013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:40.947473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:40.955040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 909/1773] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:40.962530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.023677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 865/1774] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:41.025667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.114131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fb18b-1ac5-478d-b3bb-fe6bacbfd8d2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.224281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782eff1-7c7f-4b97-8fee-e461b91b676c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.233703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.234487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.234678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.234950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.235657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.237755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.255760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.256725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.257187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.257599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.258428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.260809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.283291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 866/1775] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:41 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:41.285420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.305271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb699-8794-4151-8fef-6fd42b3c927f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.315411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 910/1776] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:40 2022] POST /identity/v3/users => generated 294 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:41.318979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.322377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.323278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.323385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.323684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.324472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.326367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.338962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe780-3325-43a7-af36-9521bcfcec7a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.339862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 867/1777] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:41.344389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.349216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.349909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.350195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.350476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.351217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.352914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.366924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 911/1778] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:14:41.372160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.381274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94022-b981-4b98-8174-5928897247b6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.390150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.391335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.391799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.392212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] PATH_INFO: `/v3/projects/473668d5cdf4458e8310d66ccad221a3/users/166250ae005b4c2a9a76049d6a117184/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.394197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a36c-614a-4e8e-b30e-ec60addf1a23 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.403009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.403737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.404050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.405176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.405343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.407579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.424746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 912/1779] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:41.426418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.432431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=473668d5cdf4458e8310d66ccad221a3, user_id=166250ae005b4c2a9a76049d6a117184, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.435346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.438166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1975948-773f-44c3-9d0a-69dfec2a41be admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.444822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.446537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.446703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.446980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] PATH_INFO: `/v3/projects/4f955a16a1f142348292788d61f50f10/users/20f3eb18ed514c1b9ad5b635c4ec9d72/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.463904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 868/1780] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:41 2022] PUT /identity/v3/projects/473668d5cdf4458e8310d66ccad221a3/users/166250ae005b4c2a9a76049d6a117184/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:41.467795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.470873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f955a16a1f142348292788d61f50f10, user_id=20f3eb18ed514c1b9ad5b635c4ec9d72, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.475424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca54f5b-e67c-4d31-9ae7-f6a1f480e801 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.511366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 913/1781] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:41 2022] PUT /identity/v3/projects/4f955a16a1f142348292788d61f50f10/users/20f3eb18ed514c1b9ad5b635c4ec9d72/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:41.522805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.523095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.523358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.586765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] MFA Rules not processed for user `20f3eb18ed514c1b9ad5b635c4ec9d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:41.588208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:41.617605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bb8ef-49db-40e8-8fad-5579d754e67c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.726135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 914/1782] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:41.730613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.756001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.760360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.760621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.769362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.770233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.771766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.810558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 869/1783] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:41.817443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.843170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9455-c561-4db6-82fe-e04ffee7f713 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.854990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80518b-1aee-41ce-8934-4ffa443ba910 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:41.867127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.868539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.869896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.870513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.872510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.878593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a9fcf-1b30-4516-9542-73989fa930e8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.882086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:41.882997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.883273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.883545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] PATH_INFO: `/v3/projects/473668d5cdf4458e8310d66ccad221a3/users/166250ae005b4c2a9a76049d6a117184/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.904368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473668d5cdf4458e8310d66ccad221a3, user_id=166250ae005b4c2a9a76049d6a117184, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:41.907216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f745b7f-67d4-477e-9171-4bc873106b49 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:41.923752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 915/1784] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:41 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:41.923752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e820a7-b3a8-48ab-8d7c-4b3922c50de6 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.923752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e820a7-b3a8-48ab-8d7c-4b3922c50de6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.923752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e820a7-b3a8-48ab-8d7c-4b3922c50de6 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:41.926706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 916/1785] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:41.926706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e820a7-b3a8-48ab-8d7c-4b3922c50de6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:41.973837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 870/1786] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:41 2022] PUT /identity/v3/projects/473668d5cdf4458e8310d66ccad221a3/users/166250ae005b4c2a9a76049d6a117184/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:41.973837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:41.973837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:41.973837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.032803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:42.040189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.095900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e820a7-b3a8-48ab-8d7c-4b3922c50de6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.103655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.104464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.104912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.105485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.107422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.109621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbba7f-34fa-4985-88f1-21bd2e5ef8f1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.151225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 917/1787] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:41 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:42.153506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.153864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.154477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.211033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 871/1788] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:14:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:42.212050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.225177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1817-b179-4182-a4b3-d7526a207323 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.232751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.234024 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.234419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.234806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.236374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.239933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.250036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] MFA Rules not processed for user `166250ae005b4c2a9a76049d6a117184`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:42.251350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.256447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 872/1789] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:42.265227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.278415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf936e-1f07-4a39-bb0d-282a14a4b58c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.285699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.287911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.288403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.289011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] PATH_INFO: `/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed/users/a1ed2801d29640d2829c28eaba73990d/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.307376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ebd67d1df54d9ca318e1901e0921ed, user_id=a1ed2801d29640d2829c28eaba73990d, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.311228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.329697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 873/1790] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:42 2022] PUT /identity/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed/users/a1ed2801d29640d2829c28eaba73990d/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:42.331909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.334084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.428291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42765a78-08d7-427a-8eed-9057d57c898c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.436098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.437002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.437361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.437730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.443534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 918/1791] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:42.443534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.463583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4ad8-b25d-44e9-98eb-f78c1b44d5f6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.469802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.474671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.497451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 874/1792] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:42.498337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.499702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.600546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.601287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.601567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.601838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.602572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.604243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.633938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 919/1793] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:42.634884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.645867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f113-861a-4af9-a092-f071a67cc39a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.651818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.652796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.653079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.653393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] PATH_INFO: `/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed/users/a1ed2801d29640d2829c28eaba73990d/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.655533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ebd67d1df54d9ca318e1901e0921ed, user_id=a1ed2801d29640d2829c28eaba73990d, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.659926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf44d-5523-4029-b7f9-f1c32885db2c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.680150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad004d9-b952-4b6c-86c7-7eab9e6eea82 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.680750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 920/1794] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:42 2022] PUT /identity/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed/users/a1ed2801d29640d2829c28eaba73990d/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:42.683504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.683797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.684071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.785418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] MFA Rules not processed for user `a1ed2801d29640d2829c28eaba73990d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:42.803265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.879041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.880328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.880811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:42.881359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:42.965484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 921/1795] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:42.977490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:42.979160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:42.992357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:42.994563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568eeac-826f-4dfa-863b-f177cf95361b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:42.994858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:42.998424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:42.999256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:42.999753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:43.000096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:43.014084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:43.015603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c6c75-0eb2-4e1a-bf9a-f9b86ff4c2d5 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:43.015730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 875/1796] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:43.040814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 922/1797] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:43.260759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:43.262522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:43.394533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997bc4-d0da-4e30-a720-3dd6ced2b3dd service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:43.408050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:43.409083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:43.409355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:43.409579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] PATH_INFO: `/v3/users/cf77b9e52f954ad996deca1ed8a56072` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:43.412369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf77b9e52f954ad996deca1ed8a56072)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:43.415302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:43.494897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf77b9e52f954ad996deca1ed8a56072'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:43.522367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf77b9e52f954ad996deca1ed8a56072'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:43.542345 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf77b9e52f954ad996deca1ed8a56072'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:43.543149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf77b9e52f954ad996deca1ed8a56072'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:43.543859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf77b9e52f954ad996deca1ed8a56072'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:43.602491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 876/1798] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:43 2022] DELETE /identity/v3/users/cf77b9e52f954ad996deca1ed8a56072 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:43.607528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:43.607816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:43.608260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:43.667354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:43.669106 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:43.835349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 923/1799] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:43.873641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:43.875502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:43.983698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:43.989318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:43.998245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61193a-d0b8-46ab-823f-00cb59b2b1f3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:44.006538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:44.007441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:44.007865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:44.008277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:44.021034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:44.022926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b6d6-3ab6-4eed-8183-fa6e1e65251f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:44.030315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5928-f230-44fe-b39f-bbb58b2c5297 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:44.035944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 877/1800] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:44.037788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:44.039161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:44.039757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:44.040271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] PATH_INFO: `/v3/users/85df3b8c89f741c598ba34afa6467445` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:44.041769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85df3b8c89f741c598ba34afa6467445)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:44.044523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:44.225666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85df3b8c89f741c598ba34afa6467445'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:44.234643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85df3b8c89f741c598ba34afa6467445'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:44.235406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85df3b8c89f741c598ba34afa6467445'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:44.275836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85df3b8c89f741c598ba34afa6467445'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:44.276834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85df3b8c89f741c598ba34afa6467445'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:44.344953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 924/1801] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:43 2022] DELETE /identity/v3/users/85df3b8c89f741c598ba34afa6467445 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:44.350092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:44.350367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:44.351057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:44.363846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:44.372406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:44.388057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:44.393453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:44.493706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f71-e9fc-4150-8db0-2e9c5e3d6c73 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:44.498490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:44.499012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:44.499285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:44.499562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:44.501512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:44.564773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 878/1802] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:44.588820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:44.590479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:44.601346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 925/1803] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:44.606661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:44.618870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:44.727233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb143b7-76e7-47c6-ae52-87d078ab039b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:44.747675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:44.748775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:44.748775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:44.749033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:44.771718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:44.777435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:44.810128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 879/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:45.869575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:45.872197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:45.886925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e716eb-2e04-42d2-abce-9eaa5abf9ab0 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:45.892479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:45.893683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:45.894040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:45.894563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] PATH_INFO: `/v3/projects/346385e457354667a174f82a08dca9c6` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:45.895989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] RBAC: Authorizing `identity:delete_project(project_id=346385e457354667a174f82a08dca9c6)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:45.898222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:45.973671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346385e457354667a174f82a08dca9c6', 'request_id': 'req-b646332e-b477-4967-bd6d-d7654664055d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:45.979704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346385e457354667a174f82a08dca9c6', 'request_id': 'req-b646332e-b477-4967-bd6d-d7654664055d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:45.991198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346385e457354667a174f82a08dca9c6', 'request_id': 'req-b646332e-b477-4967-bd6d-d7654664055d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.026842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] The token cache is being invalidate because project 346385e457354667a174f82a08dca9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:46.026842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.026842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.026842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 926/1805] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:45 2022] DELETE /identity/v3/projects/346385e457354667a174f82a08dca9c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:46.027425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:46.043501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c1014-c1af-4648-a9b9-d53bc3f4f01d service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:46.196636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:46.198080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:46.201975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:46.204901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] PATH_INFO: `/v3/users/52231b8699f940499b230760ba1a0cbe` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:46.209701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52231b8699f940499b230760ba1a0cbe)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:46.213164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:46.334457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52231b8699f940499b230760ba1a0cbe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.343029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:46.345122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:46.349575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52231b8699f940499b230760ba1a0cbe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.363358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646332e-b477-4967-bd6d-d7654664055d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:46.370008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:46.371034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52231b8699f940499b230760ba1a0cbe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.371756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52231b8699f940499b230760ba1a0cbe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.372161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:46.372510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:46.372717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52231b8699f940499b230760ba1a0cbe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.373392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] PATH_INFO: `/v3/projects/7f62874fd03d42e794afb7825d9ccd18` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:46.375116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f62874fd03d42e794afb7825d9ccd18)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:46.379365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:46.419850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 880/1806] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:46 2022] DELETE /identity/v3/users/52231b8699f940499b230760ba1a0cbe => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:46.468975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f62874fd03d42e794afb7825d9ccd18', 'request_id': 'req-a92b62ea-25c0-494f-87b9-969435bff8db'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.488775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f62874fd03d42e794afb7825d9ccd18', 'request_id': 'req-a92b62ea-25c0-494f-87b9-969435bff8db'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.515258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f62874fd03d42e794afb7825d9ccd18', 'request_id': 'req-a92b62ea-25c0-494f-87b9-969435bff8db'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.536717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] The token cache is being invalidate because project 7f62874fd03d42e794afb7825d9ccd18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:46.537645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.539819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a92b62ea-25c0-494f-87b9-969435bff8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.544698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 927/1807] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:46 2022] DELETE /identity/v3/projects/7f62874fd03d42e794afb7825d9ccd18 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:46.547790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:46.550012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:46.653268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31705fbe-28ac-467b-aea9-070de6da00c0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:46.716921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:46.717829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:46.718041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:46.718437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] PATH_INFO: `/v3/users/166250ae005b4c2a9a76049d6a117184` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:46.719664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166250ae005b4c2a9a76049d6a117184)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:46.721674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:46.798792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166250ae005b4c2a9a76049d6a117184'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.813253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166250ae005b4c2a9a76049d6a117184'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.816946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166250ae005b4c2a9a76049d6a117184'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.818185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166250ae005b4c2a9a76049d6a117184'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.818867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be627c8-e59e-4029-9ab5-acd4873ab715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166250ae005b4c2a9a76049d6a117184'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:46.844149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 881/1808] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:46 2022] DELETE /identity/v3/users/166250ae005b4c2a9a76049d6a117184 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:47.173322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:47.173789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:47.173876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:47.180083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 928/1809] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:14:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:14:47.271254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896ff0-280d-45f4-907d-b18b0930bc4c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:47.271758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896ff0-280d-45f4-907d-b18b0930bc4c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:47.271758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896ff0-280d-45f4-907d-b18b0930bc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:47.309540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b9896ff0-280d-45f4-907d-b18b0930bc4c None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:47.310784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b9896ff0-280d-45f4-907d-b18b0930bc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:47.485535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 882/1810] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:14:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:48.216301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:48.218017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.307952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94530ff9-e02b-4cb0-ac9f-905bcf14e538 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:48.323627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:48.324575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.325332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.325898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] PATH_INFO: `/v3/projects/1c047737c92845ea9a967a10a1d155c8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:48.327586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c047737c92845ea9a967a10a1d155c8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:48.329608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:48.387316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c047737c92845ea9a967a10a1d155c8', 'request_id': 'req-1bedb231-6126-42ad-b0f5-750bdd905bb9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.393709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c047737c92845ea9a967a10a1d155c8', 'request_id': 'req-1bedb231-6126-42ad-b0f5-750bdd905bb9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.404295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c047737c92845ea9a967a10a1d155c8', 'request_id': 'req-1bedb231-6126-42ad-b0f5-750bdd905bb9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.418300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] The token cache is being invalidate because project 1c047737c92845ea9a967a10a1d155c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:48.419216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.420242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.426384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 929/1811] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:48 2022] DELETE /identity/v3/projects/1c047737c92845ea9a967a10a1d155c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:48.428889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948739ea-81b0-4295-9b66-5d625c5f2770 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.429584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948739ea-81b0-4295-9b66-5d625c5f2770 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.429584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948739ea-81b0-4295-9b66-5d625c5f2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:48.452137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:48.453837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.559589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedb231-6126-42ad-b0f5-750bdd905bb9 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:48.566264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:48.567040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.567390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.567731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:48.569837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.586801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:48.590452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:48.605543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 930/1812] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:48.606596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:48.608353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.616155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-948739ea-81b0-4295-9b66-5d625c5f2770 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:48.618448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-948739ea-81b0-4295-9b66-5d625c5f2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.764477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 883/1813] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:48.775945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.776941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.777362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:48.777625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bda49-fbbc-4009-a2ca-91ca378cc4a6 service nova] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:48.788964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:48.790520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.791905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.793036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] PATH_INFO: `/v3/projects/473668d5cdf4458e8310d66ccad221a3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:48.799142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473668d5cdf4458e8310d66ccad221a3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:48.803527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:48.841466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:48.844801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:48.881557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473668d5cdf4458e8310d66ccad221a3', 'request_id': 'req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.888946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473668d5cdf4458e8310d66ccad221a3', 'request_id': 'req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.922152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473668d5cdf4458e8310d66ccad221a3', 'request_id': 'req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.968338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 884/1814] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:48.970443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:48.974235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] The token cache is being invalidate because project 473668d5cdf4458e8310d66ccad221a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:48.975616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.977563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d472e65d-1b0b-4ffd-9496-21e9e6cbb120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:48.987723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 931/1815] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:48 2022] DELETE /identity/v3/projects/473668d5cdf4458e8310d66ccad221a3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:48.990896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51089d33-4bb4-4ebc-a730-0c853b60c395 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:48.994055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d939c-4488-47a3-aa79-7e8b60c62510 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:48.995535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d939c-4488-47a3-aa79-7e8b60c62510 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:48.996266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d939c-4488-47a3-aa79-7e8b60c62510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.003609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.007434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.007738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.008019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.010322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:49.010639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.014630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.059324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 885/1816] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:49.059916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-610d939c-4488-47a3-aa79-7e8b60c62510 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:49.061408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-610d939c-4488-47a3-aa79-7e8b60c62510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:49.064839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.069533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:49.089140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 932/1817] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:49.091185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.091793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.092165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.113143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326c8-0022-441d-beec-67613802185b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.125590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.129773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.130267 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.131094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.131952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.134470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:49.138609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:49.139593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.162511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 933/1818] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:49.162511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.180562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c85af-4bb0-4229-9762-d63ba4461f31 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.190916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.193683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.194078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.194450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.195291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:49.197139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.203869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.217212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 886/1819] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:49.218347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.232006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 934/1820] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:49.234453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.262030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12065012-9413-4695-9aa2-e048ce01f3f3 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.386504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.388692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.389070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.389279 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.391181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.391597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525770b-15b7-44d5-9873-4b62f35eee26 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.397095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.407114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.408262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.408547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.409033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.412020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.418548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.473863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 935/1821] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:49.478993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.479112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 887/1822] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:49.480451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.503847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243698-3a26-44f0-90ac-a342821f195d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.636692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717526f4-cd2f-4533-8a1c-042c16d82896 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.651506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.653235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.653690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.654169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.655108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.661453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.663209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.664562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.664835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.665111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.665917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.667440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.685015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 888/1823] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:49.686276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.688175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:49.708707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 936/1824] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:49.708707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.720548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94447f44-b6b6-4e8d-b461-7e830d573efc admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.728312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.729215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.729628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.730097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.730963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.732918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.744020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 937/1825] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:49.745287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.755737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798e8-8d9c-42e2-b4cc-629fd57693a2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.767781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.768676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.768981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.769226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.769955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.771542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.809735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 938/1826] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:49.809735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.818710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35bac7-7d7d-4d82-bc58-3f8c8f8254d1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.825607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.826828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.827594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.828020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.828131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8140-a54b-4846-97a1-8bdcc6538c84 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.830353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:49.834155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:49.835055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.835334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.835648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] PATH_INFO: `/v3/projects/387a74ae0e8746218df2c9e9835d090c/users/f17b9da6f1634385abbdca76f12ba51a/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.854532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387a74ae0e8746218df2c9e9835d090c, user_id=f17b9da6f1634385abbdca76f12ba51a, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.858097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.879842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 939/1827] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:49 2022] PUT /identity/v3/projects/387a74ae0e8746218df2c9e9835d090c/users/f17b9da6f1634385abbdca76f12ba51a/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:49.882140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:49.913906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:49.916151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5e9e-29dc-4357-a65b-a7531b3916d5 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:49.929950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 889/1828] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:49.943121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:49.944570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:49.945201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:49.993756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a13de-5633-4d2f-8548-c031204d9e14 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:49.999390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.000076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.000623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.001061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.001950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.004550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.004870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] MFA Rules not processed for user `f17b9da6f1634385abbdca76f12ba51a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:50.006122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.020854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 940/1829] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:50.023555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.051141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb097-096e-4052-aa51-7d106ae1a68d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.061224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.062363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.062762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.068378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] PATH_INFO: `/v3/projects/133237ab75494837b70fc959fc45dfce/users/40e95c4fcd6c41cbbeaca50b32713426/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.094189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133237ab75494837b70fc959fc45dfce, user_id=40e95c4fcd6c41cbbeaca50b32713426, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.102295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268a3b7-e470-44a0-a8cc-1dd61c5da3b8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.126047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 941/1830] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:50 2022] PUT /identity/v3/projects/133237ab75494837b70fc959fc45dfce/users/40e95c4fcd6c41cbbeaca50b32713426/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:50.140740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.141064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.141495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.159425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 890/1831] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:50.168347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.170148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.197651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] MFA Rules not processed for user `40e95c4fcd6c41cbbeaca50b32713426`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:50.198932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.255076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a0b28-9597-49b4-9a62-7e95aeb3dbb7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.293490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 942/1832] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:50.296126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.328093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.328887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.329404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.329749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.382067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f94c-a2d7-4b42-89d1-c4993b4ef87c None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.391133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.391819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.392162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.392439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.393740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.396606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.426953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.429123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.438135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 943/1833] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:50 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:50.438970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.465986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 891/1834] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:50.476158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.491811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b716c2-c9ca-46e9-99ed-c533b48c9089 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.554442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d900-bc96-4cf5-9e84-2fd11ce9792b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.557436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.561717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.563060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.563346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] PATH_INFO: `/v3/users/f17b9da6f1634385abbdca76f12ba51a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.566308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17b9da6f1634385abbdca76f12ba51a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.570013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.585788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.586566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.586852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.587184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.587833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.589996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.618330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 944/1835] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:50 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:50.619449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.632187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecf09-6e37-4b3a-8b96-cb3619d2878d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.639641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.640321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.640737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.641037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.641766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.642342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17b9da6f1634385abbdca76f12ba51a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:50.644244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.652782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17b9da6f1634385abbdca76f12ba51a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:50.660948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 945/1836] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:50.663314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.668303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17b9da6f1634385abbdca76f12ba51a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:50.669257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17b9da6f1634385abbdca76f12ba51a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:50.670019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-63fabff5-5fc4-425b-aa6a-ad822f603b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17b9da6f1634385abbdca76f12ba51a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:50.681763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff48c-9f07-4dc4-8f1c-fc16cea43925 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.690898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.694772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.695017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 892/1837] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:50 2022] DELETE /identity/v3/users/f17b9da6f1634385abbdca76f12ba51a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:50.695115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.695115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] PATH_INFO: `/v3/projects/59dd59cb8e1e4112af072cc77aa2c069/users/25f69e1540c14268b5f6978f6dafa253/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.699470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.699759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.700037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.723231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dd59cb8e1e4112af072cc77aa2c069, user_id=25f69e1540c14268b5f6978f6dafa253, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.728006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.738506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:50.750554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.761420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 946/1838] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:50 2022] PUT /identity/v3/projects/59dd59cb8e1e4112af072cc77aa2c069/users/25f69e1540c14268b5f6978f6dafa253/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:50.762972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.764758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.875798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 893/1839] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:50.883236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca451d12-c137-4aab-b829-c0d7261f1c01 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.893077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.894565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.894865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.896513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.900685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:50.902665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:50.903068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.904805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:50.934324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 947/1840] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:50.935734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:50.950787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe66bd-5392-415e-87ed-9b975c61e062 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:50.967804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:50.971330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:50.971729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:50.972029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] PATH_INFO: `/v3/projects/59dd59cb8e1e4112af072cc77aa2c069/users/25f69e1540c14268b5f6978f6dafa253/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:50.991584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dd59cb8e1e4112af072cc77aa2c069, user_id=25f69e1540c14268b5f6978f6dafa253, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:51.001991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39d55-1503-4d21-a192-3678a55468cc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:51.037368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 948/1841] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:50 2022] PUT /identity/v3/projects/59dd59cb8e1e4112af072cc77aa2c069/users/25f69e1540c14268b5f6978f6dafa253/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:51.048886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:51.049209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:51.050059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:51.070042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7385e-ae54-40ee-9565-da973bbb6da2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:51.123304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] MFA Rules not processed for user `25f69e1540c14268b5f6978f6dafa253`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:51.124615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:51.251653 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:51.253479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:51.253984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:51.254275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:51.266823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 949/1842] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:51.278298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:51.280492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:51.336723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:51.338181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:51.356157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 894/1843] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:51.365647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2c40-fefd-45c9-bbb0-d569dccd353b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:51.369661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:51.370333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:51.370612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:51.370884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:51.381439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:51.382876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:51.394245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 950/1844] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:52.061326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.082105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af72001-7132-4083-8eb0-c7cdd7384a14 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.097237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.098859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.099740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.100164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] PATH_INFO: `/v3/users/40e95c4fcd6c41cbbeaca50b32713426` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.103740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e95c4fcd6c41cbbeaca50b32713426)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.107140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.190851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e95c4fcd6c41cbbeaca50b32713426'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.209438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e95c4fcd6c41cbbeaca50b32713426'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.220271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e95c4fcd6c41cbbeaca50b32713426'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.220478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e95c4fcd6c41cbbeaca50b32713426'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.229377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-682c51ae-fa95-4cf4-80be-6b20a9e520ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e95c4fcd6c41cbbeaca50b32713426'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.265960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.267525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.277566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 895/1845] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:52 2022] DELETE /identity/v3/users/40e95c4fcd6c41cbbeaca50b32713426 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:52.283294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.284251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.284588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.287843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc520e-6325-4eb2-8d28-8bc4f8a3ac67 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.306173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:52.307594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.363175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.365603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.366123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.367037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] PATH_INFO: `/v3/projects/387a74ae0e8746218df2c9e9835d090c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.368811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387a74ae0e8746218df2c9e9835d090c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.370846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.388350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 896/1846] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:52.399358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.403575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.441773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387a74ae0e8746218df2c9e9835d090c', 'request_id': 'req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.448883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387a74ae0e8746218df2c9e9835d090c', 'request_id': 'req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.459262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387a74ae0e8746218df2c9e9835d090c', 'request_id': 'req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.474196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] The token cache is being invalidate because project 387a74ae0e8746218df2c9e9835d090c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:52.474761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.475832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ee3f95a5-3600-4e32-8c13-c10a0cdf31c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.481430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 951/1847] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:52 2022] DELETE /identity/v3/projects/387a74ae0e8746218df2c9e9835d090c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:52.482257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2425c-fb32-43cc-a6e6-90c3bc24704e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.482960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16aa44-6fcb-46db-9de7-cc5b880375ea None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.483250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16aa44-6fcb-46db-9de7-cc5b880375ea None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.483527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16aa44-6fcb-46db-9de7-cc5b880375ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.506964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ea16aa44-6fcb-46db-9de7-cc5b880375ea None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:52.509160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ea16aa44-6fcb-46db-9de7-cc5b880375ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.548739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.550184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.550597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.551825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.553831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.598574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 952/1848] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:52.609441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.609797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.610238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.631357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.631776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:52.633140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.638216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.651151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 953/1849] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:52.653118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.660741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 897/1850] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:52.669664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5984a0-b2d0-4a5c-b321-3c96b45d73f6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.678291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.679781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.680280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.681981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.685527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:52.685848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.687512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.701456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 954/1851] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:52.706950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.719270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.721398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.732048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540282c6-e474-4cd4-b379-50bb51fd662c service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.742528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5de5c-7c1f-4f9c-97b2-b871b23c5f68 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.745327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.746142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.746548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.746976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.747848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.748067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.749045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.749329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.749612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] PATH_INFO: `/v3/users/50af923de7bb4ec58a0a691ece4a36a2` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.750783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.750901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50af923de7bb4ec58a0a691ece4a36a2)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.754268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.785708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 898/1852] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:14:52.787823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.807058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50af923de7bb4ec58a0a691ece4a36a2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.818323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50af923de7bb4ec58a0a691ece4a36a2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.819198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50af923de7bb4ec58a0a691ece4a36a2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.831166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50af923de7bb4ec58a0a691ece4a36a2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.832298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-435571ee-4abf-4d32-9b10-314829454e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50af923de7bb4ec58a0a691ece4a36a2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:52.859730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 955/1853] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:52 2022] DELETE /identity/v3/users/50af923de7bb4ec58a0a691ece4a36a2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:52.859996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ebfca-9f76-46a7-ac04-475be64a39c6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:52.865846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.867750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.868346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.890018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:52.891739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.935232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:52.936319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:52.936600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:52.938099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:52.940834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:52.945904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:52.975782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 899/1854] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:52.976816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.981491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.982514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 956/1855] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:52.983230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:52.985254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:52.998849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e14f0-8563-494e-a760-cb5855f11331 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.007241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.007798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370e29-461d-4882-a285-999dd8080e88 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.007927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.008353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.008779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.009610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.011313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.013036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.014521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.014869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.015208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] PATH_INFO: `/v3/projects/133237ab75494837b70fc959fc45dfce` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.016472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=133237ab75494837b70fc959fc45dfce)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.018763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.024159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 957/1856] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:53.026526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.031103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.089747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133237ab75494837b70fc959fc45dfce', 'request_id': 'req-8dacf2b2-c1c9-4dff-9646-6ef506423ced'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.096670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133237ab75494837b70fc959fc45dfce', 'request_id': 'req-8dacf2b2-c1c9-4dff-9646-6ef506423ced'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.106810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133237ab75494837b70fc959fc45dfce', 'request_id': 'req-8dacf2b2-c1c9-4dff-9646-6ef506423ced'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.116620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10ab6-436f-4a70-adb3-2ede572a2584 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.121665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] The token cache is being invalidate because project 133237ab75494837b70fc959fc45dfce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:53.122004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.122718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.125006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 900/1857] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:52 2022] DELETE /identity/v3/projects/133237ab75494837b70fc959fc45dfce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:53.126462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.129796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.179481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.180048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.180328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.180600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.182436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.208925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf2b2-c1c9-4dff-9646-6ef506423ced admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.213823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.214511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.214962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.215067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.215764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.217423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.230430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 901/1858] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:53.231427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.234803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.250475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b947b8-66e3-4a29-b802-3fe7dde05f08 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.264718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.265621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.266220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.266330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.266411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] PATH_INFO: `/v3/users/25f69e1540c14268b5f6978f6dafa253` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.267537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f69e1540c14268b5f6978f6dafa253)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.267644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.269697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.289569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 958/1859] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:53.290532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.302897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b5b02-1d0d-4b84-9724-b9ebf0af2711 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.308264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.309188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.309475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.309755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] PATH_INFO: `/v3/projects/faf3dd7fdd1241749cdbc51654877eec/users/4b40b70c25a74aa5a73db8e498521333/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.332159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf3dd7fdd1241749cdbc51654877eec, user_id=4b40b70c25a74aa5a73db8e498521333, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.334809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26259e-5af9-4450-b3f9-7f827211a6ee admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.350752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f69e1540c14268b5f6978f6dafa253'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.358765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 959/1860] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:53 2022] PUT /identity/v3/projects/faf3dd7fdd1241749cdbc51654877eec/users/4b40b70c25a74aa5a73db8e498521333/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:53.371684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.372321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.372321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.374144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f69e1540c14268b5f6978f6dafa253'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.386384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f69e1540c14268b5f6978f6dafa253'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.387451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f69e1540c14268b5f6978f6dafa253'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.389177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f69e1540c14268b5f6978f6dafa253'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:53.418996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 902/1861] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:53 2022] DELETE /identity/v3/users/25f69e1540c14268b5f6978f6dafa253 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:53.426825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] MFA Rules not processed for user `4b40b70c25a74aa5a73db8e498521333`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:53.428040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.516394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 960/1862] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:53.532242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.536641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:53.610707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96a22-ee87-4f60-b048-51e7b3dd4179 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:53.615981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:53.616746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:53.617028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:53.617298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:53.629861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:53.631347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740343-dcaa-462d-94be-f4df01458e09 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:53.642372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 903/1863] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:53.871144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:53.872721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.077018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d8c5b-98c7-4f89-8c64-869841ad1ae9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.083606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.084739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.085618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.085917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] PATH_INFO: `/v3/projects/59dd59cb8e1e4112af072cc77aa2c069` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.087393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59dd59cb8e1e4112af072cc77aa2c069)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.089661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.151369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59dd59cb8e1e4112af072cc77aa2c069', 'request_id': 'req-4072ccb7-646d-46c8-a1f5-c89b2c93540c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.159063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59dd59cb8e1e4112af072cc77aa2c069', 'request_id': 'req-4072ccb7-646d-46c8-a1f5-c89b2c93540c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.169877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59dd59cb8e1e4112af072cc77aa2c069', 'request_id': 'req-4072ccb7-646d-46c8-a1f5-c89b2c93540c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.193652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] The token cache is being invalidate because project 59dd59cb8e1e4112af072cc77aa2c069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:54.193955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.195929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.197978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 961/1864] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:53 2022] DELETE /identity/v3/projects/59dd59cb8e1e4112af072cc77aa2c069 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:54.203811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786973c6-bf17-4232-9786-b06d4ca75cbb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.204314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786973c6-bf17-4232-9786-b06d4ca75cbb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.204404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786973c6-bf17-4232-9786-b06d4ca75cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.238288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-786973c6-bf17-4232-9786-b06d4ca75cbb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:54.244726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-786973c6-bf17-4232-9786-b06d4ca75cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.303792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.305293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.376732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 904/1865] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:54.382848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.383602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.384162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.408355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:54.410017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.423869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 905/1866] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:54.429122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.438887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ccb7-646d-46c8-a1f5-c89b2c93540c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.439467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac9c06-bb31-477d-9385-11d67ba6df7f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.445380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.446050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.446331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.446602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.447339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:54.447637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.449333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.452162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.453408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.453809 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.454161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] PATH_INFO: `/v3/projects/8d7227129019467e9d6e6feb5591b698` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.456455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7227129019467e9d6e6feb5591b698)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.458858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.463261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 906/1867] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:14:54.468257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.480344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd90cae-e493-4874-afd0-0792cc7ec6f6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.494157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.495142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.495510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.496116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.497004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.499289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.534635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7227129019467e9d6e6feb5591b698', 'request_id': 'req-28c136fa-f1f2-42ae-8539-99d122b9f3cf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.544730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7227129019467e9d6e6feb5591b698', 'request_id': 'req-28c136fa-f1f2-42ae-8539-99d122b9f3cf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.551481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 907/1868] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:54.556003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.557846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7227129019467e9d6e6feb5591b698', 'request_id': 'req-28c136fa-f1f2-42ae-8539-99d122b9f3cf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.576736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] The token cache is being invalidate because project 8d7227129019467e9d6e6feb5591b698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:54.577258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.578079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.581900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 962/1869] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:54 2022] DELETE /identity/v3/projects/8d7227129019467e9d6e6feb5591b698 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:54.604821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.607835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.648081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d2ad-fe66-4efb-8672-2429bd959efa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.653636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.654318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.654608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.654949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.655651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.658034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.693213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 908/1870] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:54.694153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.695873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.708355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c136fa-f1f2-42ae-8539-99d122b9f3cf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.713735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.714112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171a77-1127-45eb-b913-1cdf986b334a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.715299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.715840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.716317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] PATH_INFO: `/v3/users/20f3eb18ed514c1b9ad5b635c4ec9d72` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.718364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f3eb18ed514c1b9ad5b635c4ec9d72)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.719093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.719762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.720042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.720314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.721630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.722483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.723226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.739959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 909/1871] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:54.743853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.765275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab79b-3a8f-429b-8969-ea8aa2d0b8b1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.771692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.772910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.772910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.773119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.773808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.775599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.794320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f3eb18ed514c1b9ad5b635c4ec9d72'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.800698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 910/1872] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:54.802708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.803317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f3eb18ed514c1b9ad5b635c4ec9d72'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.804006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f3eb18ed514c1b9ad5b635c4ec9d72'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.811870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f3eb18ed514c1b9ad5b635c4ec9d72'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.812728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1dfdfae8-4809-4434-8364-5776d68bcfcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f3eb18ed514c1b9ad5b635c4ec9d72'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:54.813099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73a7e-49b5-4056-a8b7-1a5464cad8d2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:54.818316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:54.819236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.819511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.819783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] PATH_INFO: `/v3/projects/4641480b5e3e43f9b01a3f17366d5994/users/014ec2331cb147caab989dbbeaedd061/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.831856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 963/1873] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:54 2022] DELETE /identity/v3/users/20f3eb18ed514c1b9ad5b635c4ec9d72 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:54.835507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4641480b5e3e43f9b01a3f17366d5994, user_id=014ec2331cb147caab989dbbeaedd061, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:54.838180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:54.854456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 911/1874] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:54 2022] PUT /identity/v3/projects/4641480b5e3e43f9b01a3f17366d5994/users/014ec2331cb147caab989dbbeaedd061/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:54.866483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:54.866886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:54.867513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:54.896626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] MFA Rules not processed for user `014ec2331cb147caab989dbbeaedd061`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:54.897942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:54.977487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 964/1875] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:54.979114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:54.982500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.114338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667742ee-c59d-4a5e-9b37-ac9df187e709 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.121339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.133038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.133038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.133038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.133038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.133038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.168963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 912/1876] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:54 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:55.170486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.182465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86aad-668d-4d0c-b11d-aa798a7fd41a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.226380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.229834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.262402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.263240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.263462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.263751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.264528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.266729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.292554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 965/1877] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:55 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:55.296350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.311269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820ea2-0bd0-42db-9d67-ac6d0420a8ed admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.311523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91845-63af-4c20-8975-d996b4a1bff1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.320111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.320364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.321344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.321622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.321909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] PATH_INFO: `/v3/projects/4f955a16a1f142348292788d61f50f10` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.324101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.324461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.324952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.325946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.328321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.329722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f955a16a1f142348292788d61f50f10)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.332398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.351713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 966/1878] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:14:55.351713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.371927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9b95-7ae1-4584-9522-21e28ed15a12 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.383657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.384963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.385310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.385675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] PATH_INFO: `/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883/users/37baf9f34c2e40bcbd555ef0c0329d0c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.407047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e1f617d0cd4e63a7aa6e2c8edb9883, user_id=37baf9f34c2e40bcbd555ef0c0329d0c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.411649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.440943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 967/1879] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:55 2022] PUT /identity/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883/users/37baf9f34c2e40bcbd555ef0c0329d0c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:55.441632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f955a16a1f142348292788d61f50f10', 'request_id': 'req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.443317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.453113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f955a16a1f142348292788d61f50f10', 'request_id': 'req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.472697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f955a16a1f142348292788d61f50f10', 'request_id': 'req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.497496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] The token cache is being invalidate because project 4f955a16a1f142348292788d61f50f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:55.497782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.499693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.506363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 913/1880] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:55 2022] DELETE /identity/v3/projects/4f955a16a1f142348292788d61f50f10 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:55.508224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.511829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.559436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb415-00a0-4c4c-9ec2-3a323066b93b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.583372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.584547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.586643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.586927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.587676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.589468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.602476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 968/1881] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:55.612766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.623451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.653126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8c5f-c096-4dd3-8bf5-cd0b8cfc9c10 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.681419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.682127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.682506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.683311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] PATH_INFO: `/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883/users/37baf9f34c2e40bcbd555ef0c0329d0c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.685800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ed1f-a2ab-46b7-87e9-dc8bdaf90101 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:55.686442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e1f617d0cd4e63a7aa6e2c8edb9883, user_id=37baf9f34c2e40bcbd555ef0c0329d0c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.692219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aca58-1905-4e7e-8bbc-687b3ca6146a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.693259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:55.694414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.695566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.695850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] PATH_INFO: `/v3/users/a1ed2801d29640d2829c28eaba73990d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.697144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ed2801d29640d2829c28eaba73990d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:55.699715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:55.707316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 969/1882] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:55 2022] PUT /identity/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883/users/37baf9f34c2e40bcbd555ef0c0329d0c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:55.718517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:55.718883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:55.719103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:55.755730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] MFA Rules not processed for user `37baf9f34c2e40bcbd555ef0c0329d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:55.757230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.802803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ed2801d29640d2829c28eaba73990d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.830177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ed2801d29640d2829c28eaba73990d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.840735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ed2801d29640d2829c28eaba73990d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.844425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ed2801d29640d2829c28eaba73990d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.858997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ed2801d29640d2829c28eaba73990d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:55.910547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 970/1883] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:14:55.924820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:55.927954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:55.930775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 914/1884] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:55 2022] DELETE /identity/v3/users/a1ed2801d29640d2829c28eaba73990d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:56.020767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f4f4-76d2-4ca4-8f67-bdb5cc8fcfe7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:56.095654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:56.097114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.097927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.098987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.197646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:56.200533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26f7fa-8653-4e2f-b67e-48b534dda10e service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:56.232150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 971/1885] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:56.397939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:56.399748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:56.515878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf807c-0dd5-465d-8c4d-9c19c482803e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:56.521474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:56.522310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.522589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.522864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] PATH_INFO: `/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.524074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ebd67d1df54d9ca318e1901e0921ed)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:56.526200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:56.577384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ebd67d1df54d9ca318e1901e0921ed', 'request_id': 'req-99381c5d-3591-4cd3-86c4-980f84f13312'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:56.584022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ebd67d1df54d9ca318e1901e0921ed', 'request_id': 'req-99381c5d-3591-4cd3-86c4-980f84f13312'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:56.598672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ebd67d1df54d9ca318e1901e0921ed', 'request_id': 'req-99381c5d-3591-4cd3-86c4-980f84f13312'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:56.614331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] The token cache is being invalidate because project f0ebd67d1df54d9ca318e1901e0921ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:56.614865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:56.615530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99381c5d-3591-4cd3-86c4-980f84f13312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:56.617459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 915/1886] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:56 2022] DELETE /identity/v3/projects/f0ebd67d1df54d9ca318e1901e0921ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:56.623119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.623628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.623811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.644813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:56.646294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:56.768939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 972/1887] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:56.770399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.770783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.771157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.826177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:56.834090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:56.847761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 916/1888] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:56.849077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:56.862878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458df778-3654-4cdc-b525-58ca11b86799 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:56.873830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:56.874613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.874960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.875314 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.876118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:14:56.876487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:56.878484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:56.898004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 973/1889] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:14:56.902036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:56.920456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7208c-5514-49ec-80ad-bb7213bbf60b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:56.952684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:56.953500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:56.954041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:56.954328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:56.955034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:56.957746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.017616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 917/1890] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:56 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:57.021587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.041336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f722-ff8f-4f33-a1a0-35739f1afb6d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.157491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.160305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.160598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.160908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.161615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.163543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.212752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 974/1891] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:57 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:57.218264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.240362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66d90-d8f5-4c3e-856d-7411e4f8a3d5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.247092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.247915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.248293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.248726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.249603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.251437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.274836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 918/1892] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:57.275059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.290404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bc776-7333-4559-b33c-d80852292bc5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.295086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.295607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.295888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.296161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.296925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.298510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596a958-bd67-4dba-84e8-330d39e8c8c4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.321828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 975/1893] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:57.327622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.348627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d54e-159c-4d6f-8a2b-65ca64243466 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.361038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.363331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.363901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.364320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] PATH_INFO: `/v3/projects/c146bb2be3ce463e90e6e8cb970643d4/users/b609743259fe4d2ca5f9a5a8f8c41602/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.384217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c146bb2be3ce463e90e6e8cb970643d4, user_id=b609743259fe4d2ca5f9a5a8f8c41602, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.387056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.406648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 919/1894] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:57 2022] PUT /identity/v3/projects/c146bb2be3ce463e90e6e8cb970643d4/users/b609743259fe4d2ca5f9a5a8f8c41602/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:57.417875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.418758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.419048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.459401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] MFA Rules not processed for user `b609743259fe4d2ca5f9a5a8f8c41602`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:57.463866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:57.568700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 976/1895] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:57.572099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.656411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6fc7-e2a1-4b2f-a157-c96784edd9de admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.665792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.666795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.667309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.667584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.668284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.670240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.701913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 920/1896] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:14:57 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:14:57.709424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.722850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c466c5a-ced4-464c-b23c-53c3661dae1d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.795500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.796179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.796462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.796781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.797807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.799487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.823691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 977/1897] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:14:57 2022] POST /identity/v3/users => generated 302 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:14:57.828234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.840161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4c6df-33bd-4070-8860-fd3197f28ae8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.850379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.851095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.851371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.851645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.852376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.853998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.865210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 921/1898] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:14:57.869326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.880245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95222-65d7-44bf-8750-b890bd1b1c35 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:57.886850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:57.887760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:57.888040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:57.888308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] PATH_INFO: `/v3/projects/dc3ab140794b4a96806e25193f390c47/users/8bf531fbe2ea43c69fe8b0a4f11076c8/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:57.906682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3ab140794b4a96806e25193f390c47, user_id=8bf531fbe2ea43c69fe8b0a4f11076c8, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:57.909946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:57.929455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 978/1899] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:57 2022] PUT /identity/v3/projects/dc3ab140794b4a96806e25193f390c47/users/8bf531fbe2ea43c69fe8b0a4f11076c8/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:57.933223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:57.945132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0619-a6dc-41a2-a9fd-62215cde696c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.014299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.014978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.015254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.015523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.016251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.019416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a797-0340-4c3f-bbcd-20081c0e2470 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.029971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 922/1900] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:14:58.034805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:58.066400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157bca-bbac-4825-86b4-669913fee1dc admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.071398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.073020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.073298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.073577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] PATH_INFO: `/v3/projects/dc3ab140794b4a96806e25193f390c47/users/8bf531fbe2ea43c69fe8b0a4f11076c8/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.077457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3ab140794b4a96806e25193f390c47, user_id=8bf531fbe2ea43c69fe8b0a4f11076c8, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.078670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.097126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 979/1901] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:14:58 2022] PUT /identity/v3/projects/dc3ab140794b4a96806e25193f390c47/users/8bf531fbe2ea43c69fe8b0a4f11076c8/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:58.104532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.105021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.105913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.140846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] MFA Rules not processed for user `8bf531fbe2ea43c69fe8b0a4f11076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:58.142633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.159447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:58.161407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.251158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 923/1902] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:58.262961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:58.270064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.282266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f028-61b6-4ea6-9b85-9d4f77f3b076 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.305954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.306109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.306377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.306596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] PATH_INFO: `/v3/users/014ec2331cb147caab989dbbeaedd061` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.308328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014ec2331cb147caab989dbbeaedd061)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.315584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.421716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec1b6d-2a1c-4b91-914b-2286385a4020 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.434794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.436082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.436822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.437910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.439244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014ec2331cb147caab989dbbeaedd061'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:58.453447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014ec2331cb147caab989dbbeaedd061'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:58.454436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014ec2331cb147caab989dbbeaedd061'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:58.464599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.470211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c60cac-5673-4574-bd12-151479d304df service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.489529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014ec2331cb147caab989dbbeaedd061'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:58.490477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014ec2331cb147caab989dbbeaedd061'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:58.507910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 924/1903] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:58.537607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 980/1904] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:58 2022] DELETE /identity/v3/users/014ec2331cb147caab989dbbeaedd061 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:14:58.542155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.542815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.543388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.568963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:14:58.573672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.582706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:58.584238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.652704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 925/1905] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:14:58.669370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:58.673736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.693988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49883c-6954-4cd6-86c9-eeb9ce10be61 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.702666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.703562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.704011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.704574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.707837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:58.787304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb7f6-8184-4e47-8caa-013ea41837fe None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:58.806106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:58.808204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:58.808448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:58.808705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:58.832210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.835334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:58.837047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.837765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:58.854079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 981/1906] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:14:58.874985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 926/1907] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:14:59.382935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:59.384349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:14:59.410799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c9a-8a47-416f-939c-6231db7c1b6e service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:59.416156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:59.417081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:59.417917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:59.417917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] PATH_INFO: `/v3/projects/4641480b5e3e43f9b01a3f17366d5994` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:59.419637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4641480b5e3e43f9b01a3f17366d5994)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:59.421886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:59.511415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4641480b5e3e43f9b01a3f17366d5994', 'request_id': 'req-6a82fb04-5539-49de-91a9-b375a4cd8c44'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.540190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4641480b5e3e43f9b01a3f17366d5994', 'request_id': 'req-6a82fb04-5539-49de-91a9-b375a4cd8c44'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.561744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4641480b5e3e43f9b01a3f17366d5994', 'request_id': 'req-6a82fb04-5539-49de-91a9-b375a4cd8c44'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.576757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] The token cache is being invalidate because project 4641480b5e3e43f9b01a3f17366d5994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:14:59.577025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.577744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.579840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 982/1908] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:14:59 2022] DELETE /identity/v3/projects/4641480b5e3e43f9b01a3f17366d5994 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:14:59.584261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:14:59.595272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615a64-1682-4b33-beb4-f4ca9d2163cc service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:14:59.654664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:14:59.655526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:14:59.655814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:14:59.656060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] PATH_INFO: `/v3/users/37baf9f34c2e40bcbd555ef0c0329d0c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:14:59.657512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37baf9f34c2e40bcbd555ef0c0329d0c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:14:59.659520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:14:59.714369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37baf9f34c2e40bcbd555ef0c0329d0c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.722871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37baf9f34c2e40bcbd555ef0c0329d0c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.733306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37baf9f34c2e40bcbd555ef0c0329d0c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.734260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37baf9f34c2e40bcbd555ef0c0329d0c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.734857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4bc49c73-4972-4143-931b-80c37d7dd6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37baf9f34c2e40bcbd555ef0c0329d0c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:14:59.753206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 927/1909] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:14:59 2022] DELETE /identity/v3/users/37baf9f34c2e40bcbd555ef0c0329d0c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:00.052631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.055133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:00.083787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fb04-5539-49de-91a9-b375a4cd8c44 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.157849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.158807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.159088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.159362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] PATH_INFO: `/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.160554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e1f617d0cd4e63a7aa6e2c8edb9883)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.162578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.219211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e1f617d0cd4e63a7aa6e2c8edb9883', 'request_id': 'req-5506a52c-79a3-433f-8ba9-7da1ba32dde4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:00.225960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e1f617d0cd4e63a7aa6e2c8edb9883', 'request_id': 'req-5506a52c-79a3-433f-8ba9-7da1ba32dde4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:00.233324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e1f617d0cd4e63a7aa6e2c8edb9883', 'request_id': 'req-5506a52c-79a3-433f-8ba9-7da1ba32dde4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:00.244699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] The token cache is being invalidate because project 64e1f617d0cd4e63a7aa6e2c8edb9883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:00.244699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:00.245062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5506a52c-79a3-433f-8ba9-7da1ba32dde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:00.246602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 983/1910] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:00 2022] DELETE /identity/v3/projects/64e1f617d0cd4e63a7aa6e2c8edb9883 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:00.251354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.251705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.252548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.272638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:00.274021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:00.339010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 928/1911] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:00.350827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.351337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.351842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.374223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:00.376838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:00.386179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 984/1912] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:00.390371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.405029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8446bf-db6e-4baf-b3eb-10f087d68cf5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.410390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.411092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.411369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.411639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.412424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:00.412774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.414370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.428472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 929/1913] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:00.432899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.445939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3c756-3983-4ef6-9dd8-f2d5733cc54e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.451180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.451854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.452161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.452438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.453194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.458220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.499342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 985/1914] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:00 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:00.504415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.514736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984d34-c801-4bdb-88fc-267150755145 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.585061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.585936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.586314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.586697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.587503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.589874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.626545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 930/1915] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:00 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:00.631523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.647456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac3c1-9ee4-4b7c-a5c6-d9919610a1ff admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.653931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.654689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.655044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.655388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.656197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.658913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.672839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 986/1916] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:00.675396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.687707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bb34-1c9b-4549-9ecf-96c0ebc74312 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.698354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.699467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.699811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.700208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.701240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.703007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145806-633c-482f-a777-acf6b4eacd2b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.715655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 931/1917] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:00.719685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:00.736488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e896f-8129-4639-a522-99ba02a92f33 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:00.743626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:00.745007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.745391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.745768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] PATH_INFO: `/v3/projects/694108d022324f39b68c5cdf3f6a883f/users/2aac0e5f53444fb88ba8ab360fb8b00b/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.772872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694108d022324f39b68c5cdf3f6a883f, user_id=2aac0e5f53444fb88ba8ab360fb8b00b, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:00.776171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:00.811800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 987/1918] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:00 2022] PUT /identity/v3/projects/694108d022324f39b68c5cdf3f6a883f/users/2aac0e5f53444fb88ba8ab360fb8b00b/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:00.823830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:00.824208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:00.824558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:00.855166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] MFA Rules not processed for user `2aac0e5f53444fb88ba8ab360fb8b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:00.856674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:01.019369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 932/1919] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:01.023864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.141955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05bf7-683f-4a87-9417-96a5c0eefe00 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.149603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.150459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.150867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.151411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.152697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.155010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.193659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 988/1920] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:01 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:01.198657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.213439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee396b-ed8f-4412-98f9-3751e27509ec None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.302130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.302893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.303172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.303437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.304127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.306063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.327067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 933/1921] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:01 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:01.331250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.342940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5151c4-f08d-4133-8ece-8660d10a10e7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.348904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.349779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.350752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.350752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.351471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.353183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.366713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 989/1922] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:01.371127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.384862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15effaf-a91d-4e31-8581-079d017500d0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.397592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.400168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.400457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.400759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] PATH_INFO: `/v3/projects/0d004ab285374da6aa1c9ca39e90cec6/users/47120b8876b1407a95e61899ef892428/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.416778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d004ab285374da6aa1c9ca39e90cec6, user_id=47120b8876b1407a95e61899ef892428, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.419411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.433981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 934/1923] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:01 2022] PUT /identity/v3/projects/0d004ab285374da6aa1c9ca39e90cec6/users/47120b8876b1407a95e61899ef892428/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:01.437915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.448465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321e764-2c80-4a50-a1f0-dd4cdf36b983 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.517294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.522242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.522242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.522242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.522242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.522242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e55b5-8197-4bb5-929d-04c72b45dc03 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.542822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 990/1924] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:01.547137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.558124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e5e-4010-4975-bee7-33cc211376ad admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.563213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.564102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.565562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.565562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] PATH_INFO: `/v3/projects/0d004ab285374da6aa1c9ca39e90cec6/users/47120b8876b1407a95e61899ef892428/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.567293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d004ab285374da6aa1c9ca39e90cec6, user_id=47120b8876b1407a95e61899ef892428, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.570112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.585673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 935/1925] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:01 2022] PUT /identity/v3/projects/0d004ab285374da6aa1c9ca39e90cec6/users/47120b8876b1407a95e61899ef892428/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:01.598591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.598877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.599154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.636605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] MFA Rules not processed for user `47120b8876b1407a95e61899ef892428`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:01.638662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:01.740701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 991/1926] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:01.751589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:01.754163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:01.815805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a518e8-4efa-4435-83f0-104e0173b13d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:01.819676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:01.820505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:01.820612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:01.820894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:01.833572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:01.835246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:01.844915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 936/1927] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:02.167487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.177009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d1f7-4ad4-4d35-b03e-a1c7539befb9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.181470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47120b8876b1407a95e61899ef892428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d004ab285374da6aa1c9ca39e90cec6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.182118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.182396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.182667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.183413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:02.183717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.185679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.200523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 992/1928] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:02.204819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.213806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785972-8d7d-4fde-8d9d-d7767d158d5f service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.218370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47120b8876b1407a95e61899ef892428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d004ab285374da6aa1c9ca39e90cec6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.219013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.219295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.219569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.220260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.222314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.246614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 937/1929] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:02 2022] POST /identity/v3/projects => generated 354 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:02.250781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.262626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed259-9539-481a-bc7d-380ff2fa041e tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.333544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47120b8876b1407a95e61899ef892428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d004ab285374da6aa1c9ca39e90cec6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.334299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.334651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.334991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.335842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:02.336215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.337923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.350428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 993/1930] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:02.386573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.398245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179538-aabf-40a3-8a06-a760f976b8bb tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.409064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47120b8876b1407a95e61899ef892428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d004ab285374da6aa1c9ca39e90cec6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.409968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.410249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.410517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] PATH_INFO: `/v3/projects/0a89ec29879b43d49c706d95cdd6f732` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.412103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a89ec29879b43d49c706d95cdd6f732)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.414719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.470110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a89ec29879b43d49c706d95cdd6f732', 'request_id': 'req-9c6dd2bb-537d-4410-bec9-2987d62f19fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.480025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a89ec29879b43d49c706d95cdd6f732', 'request_id': 'req-9c6dd2bb-537d-4410-bec9-2987d62f19fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.490625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a89ec29879b43d49c706d95cdd6f732', 'request_id': 'req-9c6dd2bb-537d-4410-bec9-2987d62f19fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.509966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] The token cache is being invalidate because project 0a89ec29879b43d49c706d95cdd6f732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:02.510280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.510926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.512897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 938/1931] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:02 2022] DELETE /identity/v3/projects/0a89ec29879b43d49c706d95cdd6f732 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:02.654073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.655763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:02.728605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be653-f7bd-49fa-9403-814cbe6abaec tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.778283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:02.783512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:02.824896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.826246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.826701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.827109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] PATH_INFO: `/v3/users/b609743259fe4d2ca5f9a5a8f8c41602` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.828992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b609743259fe4d2ca5f9a5a8f8c41602)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.832475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.872814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd2bb-537d-4410-bec9-2987d62f19fc tempest-VolumeQuotaClassesTest-1901654799 tempest-VolumeQuotaClassesTest-1901654799-project-admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:02.879670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:02.880693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.881032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.881370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] PATH_INFO: `/v3/users/2aac0e5f53444fb88ba8ab360fb8b00b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.882911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aac0e5f53444fb88ba8ab360fb8b00b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:02.885849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:02.890365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b609743259fe4d2ca5f9a5a8f8c41602'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.898668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b609743259fe4d2ca5f9a5a8f8c41602'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.899482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b609743259fe4d2ca5f9a5a8f8c41602'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.909726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b609743259fe4d2ca5f9a5a8f8c41602'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.910422 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-421b54dd-90ba-4631-8199-db6ab666b51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b609743259fe4d2ca5f9a5a8f8c41602'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.932470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 994/1932] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:02 2022] DELETE /identity/v3/users/b609743259fe4d2ca5f9a5a8f8c41602 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:02.937746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.938139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.938494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:02.950611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aac0e5f53444fb88ba8ab360fb8b00b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.960869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:02.961476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aac0e5f53444fb88ba8ab360fb8b00b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.962799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:02.969102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aac0e5f53444fb88ba8ab360fb8b00b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.969763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aac0e5f53444fb88ba8ab360fb8b00b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.970363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ce9e1b55-73ca-4078-8b90-c237cfd3b943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aac0e5f53444fb88ba8ab360fb8b00b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:02.992213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 939/1933] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:02 2022] DELETE /identity/v3/users/2aac0e5f53444fb88ba8ab360fb8b00b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:02.999068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:02.999376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:02.999874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.027788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:03.030879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.047152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 995/1934] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:03.059271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.061189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.145247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 940/1935] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:03.153036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7db2-9e05-4321-9e93-c6a4e3740bcc None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.181715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.183571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.209703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.210474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.210819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.211171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.221425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.222856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.232238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 996/1936] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:03.254290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd344-87ed-45cf-9fd2-c218d47e6a4f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.257859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.258503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.258779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.259047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.269078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.270508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.280149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 941/1937] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:15:03.570824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.572594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.587706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8195e2-8c64-4ef6-a25e-14328c3ea60d service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.593334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.595010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.595359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.596338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] PATH_INFO: `/v3/projects/c146bb2be3ce463e90e6e8cb970643d4` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.598978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c146bb2be3ce463e90e6e8cb970643d4)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.601439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.677983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c146bb2be3ce463e90e6e8cb970643d4', 'request_id': 'req-52cc1085-3671-4886-81d3-6b53379dc989'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.696195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.697358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c146bb2be3ce463e90e6e8cb970643d4', 'request_id': 'req-52cc1085-3671-4886-81d3-6b53379dc989'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.698697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.709042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c146bb2be3ce463e90e6e8cb970643d4', 'request_id': 'req-52cc1085-3671-4886-81d3-6b53379dc989'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.714914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f148-6961-4605-8d2a-a14b68f98cb1 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.736269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] The token cache is being invalidate because project c146bb2be3ce463e90e6e8cb970643d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:03.739450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.740250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.744064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 997/1938] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:03 2022] DELETE /identity/v3/projects/c146bb2be3ce463e90e6e8cb970643d4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:03.749281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.751495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.803527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.805059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.805655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.806096 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] PATH_INFO: `/v3/projects/694108d022324f39b68c5cdf3f6a883f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.807461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694108d022324f39b68c5cdf3f6a883f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.810344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.856573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1085-3671-4886-81d3-6b53379dc989 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.879992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694108d022324f39b68c5cdf3f6a883f', 'request_id': 'req-bd08e4d7-263e-4e65-a79a-439f699fe302'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.886123 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694108d022324f39b68c5cdf3f6a883f', 'request_id': 'req-bd08e4d7-263e-4e65-a79a-439f699fe302'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.896596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694108d022324f39b68c5cdf3f6a883f', 'request_id': 'req-bd08e4d7-263e-4e65-a79a-439f699fe302'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.910011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] The token cache is being invalidate because project 694108d022324f39b68c5cdf3f6a883f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:03.910417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.911122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:03.913257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 942/1939] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:03 2022] DELETE /identity/v3/projects/694108d022324f39b68c5cdf3f6a883f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:03.916836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:03.918241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:03.923123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.924970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.925322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.925663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] PATH_INFO: `/v3/users/8bf531fbe2ea43c69fe8b0a4f11076c8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.927083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf531fbe2ea43c69fe8b0a4f11076c8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.928957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.936913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e4d7-263e-4e65-a79a-439f699fe302 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:03.942845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:03.944121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:03.944472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:03.945144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] PATH_INFO: `/v3/users/47120b8876b1407a95e61899ef892428` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:03.946498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47120b8876b1407a95e61899ef892428)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:03.949222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:03.995045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf531fbe2ea43c69fe8b0a4f11076c8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.005236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf531fbe2ea43c69fe8b0a4f11076c8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.005982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf531fbe2ea43c69fe8b0a4f11076c8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.014606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf531fbe2ea43c69fe8b0a4f11076c8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.015483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf531fbe2ea43c69fe8b0a4f11076c8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.020518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47120b8876b1407a95e61899ef892428'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.029342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47120b8876b1407a95e61899ef892428'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.039554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 998/1940] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:03 2022] DELETE /identity/v3/users/8bf531fbe2ea43c69fe8b0a4f11076c8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:04.039873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47120b8876b1407a95e61899ef892428'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.039873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47120b8876b1407a95e61899ef892428'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.039873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47120b8876b1407a95e61899ef892428'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.061884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 943/1941] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:03 2022] DELETE /identity/v3/users/47120b8876b1407a95e61899ef892428 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:04.657801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:04.660261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:04.671552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:04.672782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:04.755914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399526-95d3-4613-83ee-747ef5718bdb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:04.761452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:04.762519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.762950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.763318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] PATH_INFO: `/v3/projects/0d004ab285374da6aa1c9ca39e90cec6` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.764607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d004ab285374da6aa1c9ca39e90cec6)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:04.766670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:04.779656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed331ef7-35cc-411c-bc86-b79e123c6e61 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:04.786872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:04.788098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.788598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.789105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] PATH_INFO: `/v3/projects/dc3ab140794b4a96806e25193f390c47` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.791387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3ab140794b4a96806e25193f390c47)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:04.793612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:04.823757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d004ab285374da6aa1c9ca39e90cec6', 'request_id': 'req-a14f1415-5a6f-4f79-a83e-c242b890ffa5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.830841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d004ab285374da6aa1c9ca39e90cec6', 'request_id': 'req-a14f1415-5a6f-4f79-a83e-c242b890ffa5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.839940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d004ab285374da6aa1c9ca39e90cec6', 'request_id': 'req-a14f1415-5a6f-4f79-a83e-c242b890ffa5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.849629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3ab140794b4a96806e25193f390c47', 'request_id': 'req-06699886-7eff-442a-ab13-e43a78dd9024'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.852912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] The token cache is being invalidate because project 0d004ab285374da6aa1c9ca39e90cec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:04.853595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.855253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a14f1415-5a6f-4f79-a83e-c242b890ffa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.856195 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3ab140794b4a96806e25193f390c47', 'request_id': 'req-06699886-7eff-442a-ab13-e43a78dd9024'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.861950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 944/1942] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:04 2022] DELETE /identity/v3/projects/0d004ab285374da6aa1c9ca39e90cec6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:04.866299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986426b-7d7e-413f-a454-ef692cc44e25 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.866616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986426b-7d7e-413f-a454-ef692cc44e25 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.867086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986426b-7d7e-413f-a454-ef692cc44e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.871526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3ab140794b4a96806e25193f390c47', 'request_id': 'req-06699886-7eff-442a-ab13-e43a78dd9024'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.886851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] The token cache is being invalidate because project dc3ab140794b4a96806e25193f390c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:04.887139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.887981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06699886-7eff-442a-ab13-e43a78dd9024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:04.890088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 999/1943] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:04 2022] DELETE /identity/v3/projects/dc3ab140794b4a96806e25193f390c47 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:04.895725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad6da-d1a6-4429-9c36-1096efc5138d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.896078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad6da-d1a6-4429-9c36-1096efc5138d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.896336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6986426b-7d7e-413f-a454-ef692cc44e25 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:04.896448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad6da-d1a6-4429-9c36-1096efc5138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.897587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6986426b-7d7e-413f-a454-ef692cc44e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:04.916597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5f0ad6da-d1a6-4429-9c36-1096efc5138d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:04.917952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5f0ad6da-d1a6-4429-9c36-1096efc5138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:04.963677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 945/1944] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:04.971742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.972306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.972817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.984238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1000/1945] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:04.993053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:04.993340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:04.993617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:04.996420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:04.997939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:05.013141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:05.013861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 946/1946] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:05.014790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:05.018682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.027989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1001/1947] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:05.030901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558423-5fad-4205-9a28-d446c40d9b9e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.032294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.036680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.037646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.037759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.038176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.038926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:05.039973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.041029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.042629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad500a3-334f-4773-b013-f94e58680ad9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.055522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 947/1948] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:15:05.060589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.061011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.062097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.062406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.062684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.063419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:05.063719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.065586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.078163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a603-4c26-4b93-ae38-3b551729ad9d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.078867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1002/1949] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:05.083819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.085339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.086196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.086485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.086936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.092796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.092796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.102458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfab09-b628-4447-a53d-8e4b87bbea2d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.107931 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.108842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.109125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.109395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.110366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.113089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.124519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 948/1950] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:05.128535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.145987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1003/1951] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:05.149859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.211695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c899d-8e6a-46e2-9268-571e1fe866d7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.240000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8d03-c77d-4811-a43c-54d0ad8dfc35 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.244730 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.245440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.245698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.245972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.246886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.248843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.294692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1004/1952] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:05.295709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.299234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.299989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.300266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.300537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.301256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.303170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.306030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54d9f-9a16-4e3f-9118-e0f74829c33d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.310859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.311402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.311854 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.312135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.312888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.315305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.329483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1005/1953] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:05.336700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 949/1954] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:05.339773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.343245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.350354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef804e-dc78-40a7-aec1-19df43f5f6a0 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.354547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c041f-4e72-4851-ac98-67c80827e3be admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.355341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.356334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.356334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.356532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.357302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.358908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.361512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.362178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.362448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.362716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.363433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.365272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.371235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1006/1955] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:05.374934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.382156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 950/1956] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:05.383766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.386787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb74cb-f4a8-42a8-92e8-8fdbeccfca7d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.391528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.392255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.393258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.393603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.394150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc49d2-d343-458b-b590-c19fe866bd86 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.394446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.396097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.399037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.399907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.400183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.400453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] PATH_INFO: `/v3/projects/ec83616a4ec74a71ae37bf663f0e0812/users/dd3d9b80c93f4868b6b5249425a0a565/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.412151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1007/1957] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:05.416215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.426844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec83616a4ec74a71ae37bf663f0e0812, user_id=dd3d9b80c93f4868b6b5249425a0a565, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.428636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04233-2598-478a-8b71-a419f6635f54 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.429536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa8e4f-f8c6-4fbf-8a3d-a577bcbb1cce admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.433549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.434492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.434893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.435236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] PATH_INFO: `/v3/projects/b8b0b3979c0b4ef0aaffc3946e4c6379/users/9d929e18823b4339968f1a5727597102/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.446233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 951/1958] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:05 2022] PUT /identity/v3/projects/ec83616a4ec74a71ae37bf663f0e0812/users/dd3d9b80c93f4868b6b5249425a0a565/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:05.457848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.458369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.458649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.461029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b0b3979c0b4ef0aaffc3946e4c6379, user_id=9d929e18823b4339968f1a5727597102, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.463982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b9254-6932-4f2e-81fb-fc81dfe7eb8e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.488529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1008/1959] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:05 2022] PUT /identity/v3/projects/b8b0b3979c0b4ef0aaffc3946e4c6379/users/9d929e18823b4339968f1a5727597102/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:05.491066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] MFA Rules not processed for user `dd3d9b80c93f4868b6b5249425a0a565`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:05.492227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:05.493455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.494459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.494881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.530491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] MFA Rules not processed for user `9d929e18823b4339968f1a5727597102`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:05.531983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:05.601743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 952/1960] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:05.615234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.645738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1009/1961] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:05.657594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.660525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:05.749601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58093c4b-13bb-4814-aab3-216889b96998 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.754176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.755675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.755956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.756223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.760128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca09d-f506-4b0e-b76e-71c19d99e36a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.765474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.767023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.777918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1010/1962] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:15:05.810640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:05.811588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:05.812023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:05.812448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:05.817065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:05.822456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:05.887418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 953/1963] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/projects => generated 365 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:05.888769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:05.906637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba86e7-e7b0-45d1-8d38-2057f533b886 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:05.999148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.000309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.000920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.001486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.004041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.007146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.050697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.055760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1011/1964] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:05 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:06.078431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8276-24b1-434e-bd50-fc69d3292099 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.089466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.091164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.093195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.093515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.094396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.101402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.117814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 954/1965] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:06.121954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.141885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec465-2a9d-4f98-8313-8d79b1d3b144 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.149430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.150781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.151292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.151403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] PATH_INFO: `/v3/projects/d5f07b1979b04bf19ddf8472cfed2def/users/7fc8a86969264dde95696b290e11790b/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.167379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f07b1979b04bf19ddf8472cfed2def, user_id=7fc8a86969264dde95696b290e11790b, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.170474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.196198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1012/1966] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:06 2022] PUT /identity/v3/projects/d5f07b1979b04bf19ddf8472cfed2def/users/7fc8a86969264dde95696b290e11790b/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:06.200036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.220740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c34a5e-5f0e-4a22-9671-2588349b6d83 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.305384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.306065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.306344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.306618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.307347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.309098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819111a-5711-4d0a-83c5-fb580707d23f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.321183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 955/1967] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:06.325985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.337470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2042f2-6388-4fde-9bd0-1bb226d09db0 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.344172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.345177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.346007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.346964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] PATH_INFO: `/v3/projects/d5f07b1979b04bf19ddf8472cfed2def/users/7fc8a86969264dde95696b290e11790b/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.362470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f07b1979b04bf19ddf8472cfed2def, user_id=7fc8a86969264dde95696b290e11790b, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.365813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.382307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1013/1968] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:06 2022] PUT /identity/v3/projects/d5f07b1979b04bf19ddf8472cfed2def/users/7fc8a86969264dde95696b290e11790b/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:06.394810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.395302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.395851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.433881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] MFA Rules not processed for user `7fc8a86969264dde95696b290e11790b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:06.435200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:06.515004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 956/1969] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:06.527990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.529949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:06.623034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839b5a-aece-4c95-a299-ef1c215c6670 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.635544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.636263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.636895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.637181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.649043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.650491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.671554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1014/1970] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:06.769380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.779565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069a32b-672e-4e67-be54-b722e892ad61 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.784690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.785428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.785780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.786220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.862186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.863479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044729c-4032-4fe9-b97d-e9e1616e7b57 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.893378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 957/1971] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:12.041658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:12.215722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2bf6-acfe-41ee-bbbc-6b548ac88b8e service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:12.221077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:12.222216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:12.222792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:12.223432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] PATH_INFO: `/v3/users/dd3d9b80c93f4868b6b5249425a0a565` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:12.224901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3d9b80c93f4868b6b5249425a0a565)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:12.227535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:12.305553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3d9b80c93f4868b6b5249425a0a565'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.317835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3d9b80c93f4868b6b5249425a0a565'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.319700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3d9b80c93f4868b6b5249425a0a565'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.331505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3d9b80c93f4868b6b5249425a0a565'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.332233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3d9b80c93f4868b6b5249425a0a565'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.360710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1015/1972] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:12 2022] DELETE /identity/v3/users/dd3d9b80c93f4868b6b5249425a0a565 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:12.362716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:12.363175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:12.363264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:12.398090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:12.400405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:12.490355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 958/1973] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:12.504267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:12.507352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:12.589201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38defd-e712-4108-a4d2-22d9f2df6eca admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:12.593307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:12.593965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:12.594243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:12.594562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:12.605372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:12.607046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:12.622157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1016/1974] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:12.898357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:12.899780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:12.913087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee83b0-2c43-435d-a3cf-e76eace128f9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:12.918272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:12.919145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:12.919427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:12.920092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] PATH_INFO: `/v3/projects/ec83616a4ec74a71ae37bf663f0e0812` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:12.921396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec83616a4ec74a71ae37bf663f0e0812)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:12.923442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:12.970887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec83616a4ec74a71ae37bf663f0e0812', 'request_id': 'req-ca19f5d9-3f7e-44ec-99db-c431879faa0e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.976122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec83616a4ec74a71ae37bf663f0e0812', 'request_id': 'req-ca19f5d9-3f7e-44ec-99db-c431879faa0e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.983084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec83616a4ec74a71ae37bf663f0e0812', 'request_id': 'req-ca19f5d9-3f7e-44ec-99db-c431879faa0e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.994385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] The token cache is being invalidate because project ec83616a4ec74a71ae37bf663f0e0812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:12.994668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.995309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:12.996899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 959/1975] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:12 2022] DELETE /identity/v3/projects/ec83616a4ec74a71ae37bf663f0e0812 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:13.001090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.010999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945e6f-b9bc-4b0d-9bdc-efe29059bcdb service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.066078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.066951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.067231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.067503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] PATH_INFO: `/v3/users/7fc8a86969264dde95696b290e11790b` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.068720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc8a86969264dde95696b290e11790b)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.070632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.115400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc8a86969264dde95696b290e11790b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.122358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc8a86969264dde95696b290e11790b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.123318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc8a86969264dde95696b290e11790b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.131368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc8a86969264dde95696b290e11790b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.131980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-1b47662e-6fad-4b25-a1a8-bd7654488e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc8a86969264dde95696b290e11790b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.148724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1017/1976] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:13 2022] DELETE /identity/v3/users/7fc8a86969264dde95696b290e11790b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:13.412114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.413598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:13.427976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19f5d9-3f7e-44ec-99db-c431879faa0e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.483415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.484261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.484540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.484845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] PATH_INFO: `/v3/projects/d5f07b1979b04bf19ddf8472cfed2def` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.486619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f07b1979b04bf19ddf8472cfed2def)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.488703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.533542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f07b1979b04bf19ddf8472cfed2def', 'request_id': 'req-f65feb75-4e2a-4da5-814d-300cb4b9f98a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.538533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f07b1979b04bf19ddf8472cfed2def', 'request_id': 'req-f65feb75-4e2a-4da5-814d-300cb4b9f98a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.545000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f07b1979b04bf19ddf8472cfed2def', 'request_id': 'req-f65feb75-4e2a-4da5-814d-300cb4b9f98a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.556112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] The token cache is being invalidate because project d5f07b1979b04bf19ddf8472cfed2def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:13.556418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.557050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f65feb75-4e2a-4da5-814d-300cb4b9f98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:13.558569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 960/1977] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:13 2022] DELETE /identity/v3/projects/d5f07b1979b04bf19ddf8472cfed2def => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:13.563752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.564163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.564435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.582997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:13.584171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:13.659897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1018/1978] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:13.662267 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce787-190b-4067-999d-f2946c333888 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.662915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce787-190b-4067-999d-f2946c333888 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.662915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce787-190b-4067-999d-f2946c333888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.681219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-524ce787-190b-4067-999d-f2946c333888 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:13.684739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-524ce787-190b-4067-999d-f2946c333888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:13.695676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 961/1979] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:13.699396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.710039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3694d-cd4f-4340-b883-877d65d8ec8d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.714582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.715365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.715513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.715870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.716526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:13.716823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.718532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.733547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1019/1980] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:15:13.734949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce787-190b-4067-999d-f2946c333888 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.745300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce787-190b-4067-999d-f2946c333888 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.755391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.756139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.756420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.756886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.757588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.759481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.811124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.812871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 962/1981] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:13.829361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89eb4-b67d-4129-9c1e-cd09d6896f88 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.900330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.901063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.901464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.901738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.902423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.904759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.927661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1020/1982] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:13 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:13.932370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.945717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a2aee-f89f-4797-9d5d-2b5be5d49ab0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.950556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.951229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.951503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.951783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.952505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.954441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:13.968607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 963/1983] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:13.974562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:13.986403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfea97-148e-4aec-b493-3cdf7c310898 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:13.991317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:13.991975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:13.992257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:13.992532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:13.993383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:13.995046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ee3a3-939a-4c0c-9e22-e86521b5abb4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.009321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1021/1984] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:14.011093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.023622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211310ef-2d4c-4d6a-b0c1-bb44719bcbe7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.028765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.030161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.030493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.030765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] PATH_INFO: `/v3/projects/46a94b6f6edd4b82808596d4cdd2f14c/users/54b71048313b4386967a5ddd1a384128/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.062144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a94b6f6edd4b82808596d4cdd2f14c, user_id=54b71048313b4386967a5ddd1a384128, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.066934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.084237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 964/1985] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:14 2022] PUT /identity/v3/projects/46a94b6f6edd4b82808596d4cdd2f14c/users/54b71048313b4386967a5ddd1a384128/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:14.096119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.096722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.096973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.128386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] MFA Rules not processed for user `54b71048313b4386967a5ddd1a384128`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:14.129643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.200034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1022/1986] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:14.205364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.280799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a6a5-6f55-42ee-8fdb-3366bb0acd08 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.289307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.290395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.290869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.291341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.292552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.295347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.328476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 965/1987] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:14 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:14.332800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.348501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46eb5d-0a4c-45b1-8d09-cf2a99161a47 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.416382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.417091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.417381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.417655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.418372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.420492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.445828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1023/1988] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:14 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:14.450567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.463317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4278-9f5b-4f1d-90a5-008fe59ad1a7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.468500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.469480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.469760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.470033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.471319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.473376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.489427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 966/1989] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:14.490703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.501895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc421-b25c-4263-9a48-7c40a6fc0069 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.509317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.510797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.511242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.511688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] PATH_INFO: `/v3/projects/44578759b9ae4ec6b08c6abb825a48f0/users/79406b2ffba24fcdbddde2804ad32afd/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.530726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44578759b9ae4ec6b08c6abb825a48f0, user_id=79406b2ffba24fcdbddde2804ad32afd, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.534589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.551749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1024/1990] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:14 2022] PUT /identity/v3/projects/44578759b9ae4ec6b08c6abb825a48f0/users/79406b2ffba24fcdbddde2804ad32afd/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:14.555979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.566449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333507-50d7-4b02-85c5-23c761bcb67f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.625291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.625877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.626157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.626495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.628021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.629125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.639301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 967/1991] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:14.643820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.654165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a33-5066-462b-99b4-8efff8655e57 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.662902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.663830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.664113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.664393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] PATH_INFO: `/v3/projects/44578759b9ae4ec6b08c6abb825a48f0/users/79406b2ffba24fcdbddde2804ad32afd/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.666501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44578759b9ae4ec6b08c6abb825a48f0, user_id=79406b2ffba24fcdbddde2804ad32afd, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.669245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e43b6-e1c9-4715-91a8-38e77ba5bee5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.681688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1025/1992] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:14 2022] PUT /identity/v3/projects/44578759b9ae4ec6b08c6abb825a48f0/users/79406b2ffba24fcdbddde2804ad32afd/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:14.688997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.690822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.695817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.696102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.696370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.707073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6e167-d222-4e07-8296-122d0ddb273f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.727980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] MFA Rules not processed for user `79406b2ffba24fcdbddde2804ad32afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:14.729256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.767931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.768867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.769152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.769428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] PATH_INFO: `/v3/users/6fb881a37e3a46538ddee06f510c7fa2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.771672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb881a37e3a46538ddee06f510c7fa2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.773834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:14.806616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1026/1993] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:14.814374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.815810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.822297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb881a37e3a46538ddee06f510c7fa2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:14.839059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb881a37e3a46538ddee06f510c7fa2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:14.847101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb881a37e3a46538ddee06f510c7fa2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:14.847817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb881a37e3a46538ddee06f510c7fa2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:14.848438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb881a37e3a46538ddee06f510c7fa2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:14.868116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 968/1994] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:14 2022] DELETE /identity/v3/users/6fb881a37e3a46538ddee06f510c7fa2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:14.883234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2877ea-76c3-4f4a-974b-2f9b1ab35e96 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.889002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:14.890778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.945202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.945986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.946135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.946528 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.948684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:14.960844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a74c3c-d1ea-4f4b-9470-eead7a175dcc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:14.966032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:14.966947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:14.966947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:14.967215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] PATH_INFO: `/v3/users/9d929e18823b4339968f1a5727597102` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:14.968523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d929e18823b4339968f1a5727597102)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:14.970667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.014728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.016160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.019458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d929e18823b4339968f1a5727597102'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.026862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1027/1995] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:15:15.034163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d929e18823b4339968f1a5727597102'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.043324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d929e18823b4339968f1a5727597102'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.044094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d929e18823b4339968f1a5727597102'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.044871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7df7eb53-adad-4ad0-b799-db2b58a9ece4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d929e18823b4339968f1a5727597102'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.055881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.063261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.068726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 969/1996] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:14 2022] DELETE /identity/v3/users/9d929e18823b4339968f1a5727597102 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:15.073675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.074025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.074372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.094490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2403-3990-4f80-8182-152c35e45e3c service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.096254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:15.097551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.160630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.161461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.161838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.162130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] PATH_INFO: `/v3/projects/857b83406e874fcea2e81894d366f353` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.163358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857b83406e874fcea2e81894d366f353)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.165416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.169069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 970/1997] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:15.181619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.183423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.228996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857b83406e874fcea2e81894d366f353', 'request_id': 'req-9207cb30-5f8a-4111-bf19-3f5f198dbf95'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.236636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857b83406e874fcea2e81894d366f353', 'request_id': 'req-9207cb30-5f8a-4111-bf19-3f5f198dbf95'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.244881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857b83406e874fcea2e81894d366f353', 'request_id': 'req-9207cb30-5f8a-4111-bf19-3f5f198dbf95'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.251322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb0a47-d320-41eb-b55b-e70e0c124c2f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.260575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] The token cache is being invalidate because project 857b83406e874fcea2e81894d366f353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:15.260926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.261571 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9207cb30-5f8a-4111-bf19-3f5f198dbf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.263649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1028/1998] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:15 2022] DELETE /identity/v3/projects/857b83406e874fcea2e81894d366f353 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:15.269088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aed60-4742-4d69-a863-03b546025724 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.269377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aed60-4742-4d69-a863-03b546025724 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.269649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aed60-4742-4d69-a863-03b546025724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.290579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-260aed60-4742-4d69-a863-03b546025724 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:15.291745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-260aed60-4742-4d69-a863-03b546025724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.313220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.314424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.314884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.315389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.317859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.368267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1029/1999] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:15.375774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.376065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.376373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.397255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:15.398575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.400143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.401615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.411275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1030/2000] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:15.412194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 971/2001] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:15.412674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.422722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c8c2c-9ed3-49d4-8250-f8ce2aba23ad None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.427797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.428381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.428706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.428998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.429771 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:15.430026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.431760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.444520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1031/2002] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:15.449204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.462164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61ef1-26b1-4a76-8de7-f45e993699e6 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.468761 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.469734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.470022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.471524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.472234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.474538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.507021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 972/2003] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:15.511545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.523069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb0b3-8341-489b-80c3-83682a57a52a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.589678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.590414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.590708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.592799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.593585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.596254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.617899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1032/2004] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:15.621908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.632781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07d2ca-7358-4597-885a-9a8807083feb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.637799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.638473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.638756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.639031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.639760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.641408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.659418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 973/2005] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:15.663495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.672771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.674204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63bcc3-e00b-4c2d-91e0-4ca8c1a7b3bf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.674633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.679437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.680181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.680462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.680981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.681712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.683292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.688397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d583f9-7f49-4883-bb09-2ad6302f6e3a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.694268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.694433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1033/2006] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:15.695681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.696125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.696485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] PATH_INFO: `/v3/users/54b71048313b4386967a5ddd1a384128` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.697778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b71048313b4386967a5ddd1a384128)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.698833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.699726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.711389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51986dc-12ef-4aaa-9c79-cf007245fafc admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.716960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.717844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.718124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.719242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] PATH_INFO: `/v3/projects/5636293a7a474103ab433dbbdcdaee54/users/f6ad87f11bb64060b2267b2e4216d946/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.738191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5636293a7a474103ab433dbbdcdaee54, user_id=f6ad87f11bb64060b2267b2e4216d946, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.740870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.755316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1034/2007] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:15 2022] PUT /identity/v3/projects/5636293a7a474103ab433dbbdcdaee54/users/f6ad87f11bb64060b2267b2e4216d946/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:15.756076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b71048313b4386967a5ddd1a384128'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.757504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.765282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b71048313b4386967a5ddd1a384128'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.765442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.773478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b71048313b4386967a5ddd1a384128'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.774164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b71048313b4386967a5ddd1a384128'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.775241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-99af257e-d903-4a6d-b790-0af2c977dabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b71048313b4386967a5ddd1a384128'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.795037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 974/2008] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:15 2022] DELETE /identity/v3/users/54b71048313b4386967a5ddd1a384128 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:15.796496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb493-79fa-47da-8509-5d1c998762a0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.796886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb493-79fa-47da-8509-5d1c998762a0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.797238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb493-79fa-47da-8509-5d1c998762a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.829467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1c0cb493-79fa-47da-8509-5d1c998762a0 None None] MFA Rules not processed for user `f6ad87f11bb64060b2267b2e4216d946`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:15.835062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1c0cb493-79fa-47da-8509-5d1c998762a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.852419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af601a-98bb-494f-a66a-1c42fb146bbf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:15.918129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:15.919412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.919893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.920441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] PATH_INFO: `/v3/projects/b8b0b3979c0b4ef0aaffc3946e4c6379` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.922395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b0b3979c0b4ef0aaffc3946e4c6379)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:15.925093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:15.927376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 975/2009] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:15.929023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:15.929628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:15.930055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:15.950126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:15.951366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.960200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 976/2010] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:15.964221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:15.965608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:15.991157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b0b3979c0b4ef0aaffc3946e4c6379', 'request_id': 'req-7145d5aa-d53a-4eed-b78f-68a304bd03ac'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:15.997446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b0b3979c0b4ef0aaffc3946e4c6379', 'request_id': 'req-7145d5aa-d53a-4eed-b78f-68a304bd03ac'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.005983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b0b3979c0b4ef0aaffc3946e4c6379', 'request_id': 'req-7145d5aa-d53a-4eed-b78f-68a304bd03ac'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.017959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] The token cache is being invalidate because project b8b0b3979c0b4ef0aaffc3946e4c6379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:16.018247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.018905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.020723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1035/2011] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:15 2022] DELETE /identity/v3/projects/b8b0b3979c0b4ef0aaffc3946e4c6379 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:16.021293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.024723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.050304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710abf-e414-42d0-8d3e-6b0e7d2f9f8d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.084251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145d5aa-d53a-4eed-b78f-68a304bd03ac admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.087972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.088620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.089002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.089391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.091615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.132002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.132645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.132961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.133229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.135179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.165675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.167175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a942-2c04-4c13-bbb5-b79dd1a7733a service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.177705 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1036/2012] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:16.179652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.180019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.180475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.198979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.201279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781537-d625-4589-89ce-0be53ad94e12 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.202372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:16.203935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.213218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 977/2013] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:16.213465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1037/2014] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:16.222465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.222763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.223092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.278465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:16.279351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.296981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 978/2015] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:16.301326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.312054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e23f4-1f22-47f9-8216-6c1956a8b94f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.327898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.331664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.332208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.333890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.334824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:16.336874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.337692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.371399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1038/2016] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:16.378027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.391157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5725a-6737-46c1-97dd-2c1790d5d868 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.397657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.398241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.398521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.398793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.399524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.401467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.436323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 979/2017] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:16.440939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.452677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f27f-e599-4152-8da7-e784f0117d6e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.505360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.507181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.519004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.519814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.520102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.520434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.521301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.524425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.549763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1039/2018] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:16.556037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.566433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb741c-d7bb-4edd-ae58-25e1163b4b14 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.572109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.572895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.573409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.573874 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.574680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.576472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.589679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1040/2019] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:16.589679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.589679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.602296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ccada-6872-4414-98c7-31a2b0038665 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.605176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2500e-a73c-43f8-8a62-9fd7730555e8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.607434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.608304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.608585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.608895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] PATH_INFO: `/v3/projects/46a94b6f6edd4b82808596d4cdd2f14c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.609831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.610082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a94b6f6edd4b82808596d4cdd2f14c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.610745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.611647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.611919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] PATH_INFO: `/v3/users/f6ad87f11bb64060b2267b2e4216d946` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.612546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.613159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ad87f11bb64060b2267b2e4216d946)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.615090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.659376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ad87f11bb64060b2267b2e4216d946'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.660420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a94b6f6edd4b82808596d4cdd2f14c', 'request_id': 'req-ebdc60e7-4f29-4759-a41e-be664e3b87a5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.666524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ad87f11bb64060b2267b2e4216d946'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.666641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a94b6f6edd4b82808596d4cdd2f14c', 'request_id': 'req-ebdc60e7-4f29-4759-a41e-be664e3b87a5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.674873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a94b6f6edd4b82808596d4cdd2f14c', 'request_id': 'req-ebdc60e7-4f29-4759-a41e-be664e3b87a5'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.675026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ad87f11bb64060b2267b2e4216d946'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.675635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ad87f11bb64060b2267b2e4216d946'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.676250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ad87f11bb64060b2267b2e4216d946'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.686420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] The token cache is being invalidate because project 46a94b6f6edd4b82808596d4cdd2f14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:16.686671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.687366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.689278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1041/2020] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:16 2022] DELETE /identity/v3/projects/46a94b6f6edd4b82808596d4cdd2f14c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:16.689990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.691355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.693371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 980/2021] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:16 2022] DELETE /identity/v3/users/f6ad87f11bb64060b2267b2e4216d946 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:16.696925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.698271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.754206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc60e7-4f29-4759-a41e-be664e3b87a5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.758828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.759481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.759760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.760032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.760597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98334c-741c-47fd-8cee-50c2cfa2bcf3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.760897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.762473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516e53d-1871-4624-b4f9-0dd339e522ff admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.765171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.766034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.766335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.766606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] PATH_INFO: `/v3/users/79406b2ffba24fcdbddde2804ad32afd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.767837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=79406b2ffba24fcdbddde2804ad32afd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.769775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.772578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1042/2022] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:16.773951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.774248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.774530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.792122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:16.793377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.802192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1043/2023] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:16.803094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.813286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8b80-bbf6-4441-82a6-32e0d5d06ff6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.818041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.818940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.819243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.819512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] PATH_INFO: `/v3/projects/02d8746568644757a308b2366be64d68/users/437b2c0efdd047aa9a286885cf3014ce/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.822991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79406b2ffba24fcdbddde2804ad32afd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.831986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79406b2ffba24fcdbddde2804ad32afd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.835214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d8746568644757a308b2366be64d68, user_id=437b2c0efdd047aa9a286885cf3014ce, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:16.837942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:16.838813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79406b2ffba24fcdbddde2804ad32afd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.839459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79406b2ffba24fcdbddde2804ad32afd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.840081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4ada59ee-e758-440e-b8e0-758ae462f0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79406b2ffba24fcdbddde2804ad32afd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:16.851498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1044/2024] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:16 2022] PUT /identity/v3/projects/02d8746568644757a308b2366be64d68/users/437b2c0efdd047aa9a286885cf3014ce/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:16.861643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.861643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.861804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 981/2025] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:16 2022] DELETE /identity/v3/users/79406b2ffba24fcdbddde2804ad32afd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:16.864920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.865206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.865483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.893710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] MFA Rules not processed for user `437b2c0efdd047aa9a286885cf3014ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:16.894931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.922661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a10b6-5eff-47e4-8de5-b36dc2c32c34 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:16.975714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 982/2026] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:16.981151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:16.982958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:16.985238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:16.987180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:16.987522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:16.987819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:16.989798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.073953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.075383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.087567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1045/2027] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:17.088770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33521119-dd47-4325-b054-4a9ef7cb24c8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.098483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.099415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.099661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.100029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.100860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.102932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.137250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 983/2028] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:16 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.140887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.151364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6105b-826a-486e-9913-525412c17bab service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.211962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.212613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.212849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.213121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.213815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.215709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.238137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1046/2029] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.242279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.254132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbed6d3-ea72-4ed3-8e54-144abfaf5302 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.259421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.260204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.260482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.261016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.261723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.263604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.268223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.269979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.275227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 984/2030] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:17.279142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.283694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faa0e6-da7b-4315-aff1-6acad11678e2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.289657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.290592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.290939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.291300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] PATH_INFO: `/v3/projects/44578759b9ae4ec6b08c6abb825a48f0` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.292634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44578759b9ae4ec6b08c6abb825a48f0)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.294727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.296875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1d2c-4b41-411e-99f1-278854b37a71 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.303839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.304449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.304775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.305053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.305787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.307681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.320800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 985/2031] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:17.323967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.335008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33112038-fa76-470e-b2d7-002c5f4ec44c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.341397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.342347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.342623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.342923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] PATH_INFO: `/v3/projects/f5bcf7e296c94f5da88dac23b5d9ffdc/users/02d6b0a0dae54ab1b5a1e17cf7974696/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.364850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44578759b9ae4ec6b08c6abb825a48f0', 'request_id': 'req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.370493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44578759b9ae4ec6b08c6abb825a48f0', 'request_id': 'req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.381076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44578759b9ae4ec6b08c6abb825a48f0', 'request_id': 'req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.385807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcf7e296c94f5da88dac23b5d9ffdc, user_id=02d6b0a0dae54ab1b5a1e17cf7974696, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.388636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47859a-68e2-4959-a912-d77a93d553a0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.400105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] The token cache is being invalidate because project 44578759b9ae4ec6b08c6abb825a48f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:17.400448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.401131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2ff1db97-0a45-4de8-9d64-d9aa2d5dee3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.404770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1047/2032] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:17 2022] DELETE /identity/v3/projects/44578759b9ae4ec6b08c6abb825a48f0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:17.404873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 986/2033] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:17 2022] PUT /identity/v3/projects/f5bcf7e296c94f5da88dac23b5d9ffdc/users/02d6b0a0dae54ab1b5a1e17cf7974696/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:17.409746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.410285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.410285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.422667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abf3-60b5-4e1a-aadc-ead4108106f8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.424998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abf3-60b5-4e1a-aadc-ead4108106f8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.425767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abf3-60b5-4e1a-aadc-ead4108106f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.430623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:17.431887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.456377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6af8abf3-60b5-4e1a-aadc-ead4108106f8 None None] MFA Rules not processed for user `02d6b0a0dae54ab1b5a1e17cf7974696`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:17.457696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6af8abf3-60b5-4e1a-aadc-ead4108106f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.510727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1048/2034] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:17.511575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.513145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.526905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6330c-c957-45f1-923b-8e7d8dfb8ad3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.531994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.532332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 987/2035] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:17.533942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.534230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.534500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.537469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.537757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.538032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] PATH_INFO: `/v3/projects/5636293a7a474103ab433dbbdcdaee54` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.539287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5636293a7a474103ab433dbbdcdaee54)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.541198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.553723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:17.554970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.562844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 988/2036] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:17.563694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.568105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.581030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00871ab-a30b-45a4-83b1-f4c91591f8f2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.588494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5636293a7a474103ab433dbbdcdaee54', 'request_id': 'req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.593846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5636293a7a474103ab433dbbdcdaee54', 'request_id': 'req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.601618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5636293a7a474103ab433dbbdcdaee54', 'request_id': 'req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.613294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] The token cache is being invalidate because project 5636293a7a474103ab433dbbdcdaee54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:17.613583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.614225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:17.615813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1049/2037] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:17 2022] DELETE /identity/v3/projects/5636293a7a474103ab433dbbdcdaee54 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:17.616564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.617884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.637057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.637869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.638147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.638433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.639090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.640991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c09b-b315-48b3-9082-8b6f759f03ce admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.670328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 989/2038] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.671947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.672441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.672975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.685017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e9d1-9c1c-4763-96e4-0f3db1ba212d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.690381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:17.691563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.739716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.740398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.740704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.740978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.741706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:17.742009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.743631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd94fc-c311-4b76-bd1c-3a3c78be6b0e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.748146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 990/2039] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:17.748928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.750195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.759728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1050/2040] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:17.759728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.759728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.759728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.762262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75a76-90f2-42d9-a65f-6ee3adbd2cac None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.766802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.768019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.768296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.768568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.769284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.771178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.777313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:17.778495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:17.787864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1051/2041] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:17.788725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.792717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 991/2042] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.793527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.798885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14d10-a2e6-4078-9e0d-a640d7c9406a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.803753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.803975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc4e5-bf46-4a32-99b8-171813636775 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.804402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.804706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.804986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.805662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.807574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.809054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.809702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.809983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.810257 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.810970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:17.811396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.813080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.828822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 992/2043] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:17.828822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.836627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1052/2044] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.836627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.842061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff07e2b-8ef0-4f37-95a0-da30415e6e51 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.894890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c76fb-fda9-489e-b9e8-0cc4d33a3054 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.895878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.896554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.896870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.897144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.898106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.899561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.899672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.900212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.900491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.900798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.901486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.903356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.910653 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 993/2045] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:17.911430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.922090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e312-4cf4-469a-9ee1-01749d85c0a4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.928603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.929287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.929563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.929837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:17.930518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:17.934150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1053/2046] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.934150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.934383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:17.956061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 994/2047] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:17.956061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:17.963364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cfcc-2a83-4d65-9382-32724e7101fd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.992819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309bd7-10cd-481e-8ece-d3948dae3fbb admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:17.997478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:17.998402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:17.998623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:17.998887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] PATH_INFO: `/v3/projects/87e06355164840119f89dbab6e514f11/users/9ac771c30c7349a7ae92b42bfec312da/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.015095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e06355164840119f89dbab6e514f11, user_id=9ac771c30c7349a7ae92b42bfec312da, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.018410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.018580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.019254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.019538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.019811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.020503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.022515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.032218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1054/2048] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:17 2022] PUT /identity/v3/projects/87e06355164840119f89dbab6e514f11/users/9ac771c30c7349a7ae92b42bfec312da/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:18.032999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.050180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 995/2049] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:17 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:18.050180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.060695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e313a-d836-4a44-bb46-d724eada90fa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.097269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfe92-392d-4e18-9d78-61d9b3b7a8db admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.101816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.102474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.102752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.103018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.103728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.105456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.115245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1055/2050] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.115846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.117595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.118463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.118747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.119020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.119749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.121381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.125013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc016c8-662d-4ee5-b569-779d1749fd04 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.130660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.131301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.131581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.131859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.135473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 996/2051] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.135615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.135695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.135808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.143711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1c8a-6957-4b13-930c-413e34915564 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.149124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1056/2052] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.149124 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.151670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.152341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.152619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.153339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.153713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.155314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.160546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c413c8-cf0d-491e-b9ea-b42c736ec5f5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.165494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.166382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 997/2053] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.166569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.167197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.167474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.167769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] PATH_INFO: `/v3/projects/87e06355164840119f89dbab6e514f11/users/9ac771c30c7349a7ae92b42bfec312da/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.170758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e06355164840119f89dbab6e514f11, user_id=9ac771c30c7349a7ae92b42bfec312da, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.173808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.178751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c318990-953b-4323-8141-78423f377e63 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.185547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1057/2054] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:18 2022] PUT /identity/v3/projects/87e06355164840119f89dbab6e514f11/users/9ac771c30c7349a7ae92b42bfec312da/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:18.194975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.248517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.249137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.249416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.249686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.250542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.252943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632d324-0863-42d3-bc4d-26054883b25e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.262307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283627a-0b7e-4098-ab63-31d2f6fd600f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.265992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 998/2055] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.265992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d3b-e2d5-43bd-a2e5-9d7fc3dce5b6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.265992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d3b-e2d5-43bd-a2e5-9d7fc3dce5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.265992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d3b-e2d5-43bd-a2e5-9d7fc3dce5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.268713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.269606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.269891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.270166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] PATH_INFO: `/v3/projects/e014057f36034765ac1778f1d159b209/users/aaaaf64ec45e4855804fce9f6ddd2ff4/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.291500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e014057f36034765ac1778f1d159b209, user_id=aaaaf64ec45e4855804fce9f6ddd2ff4, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.293992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4b897d3b-e2d5-43bd-a2e5-9d7fc3dce5b6 None None] MFA Rules not processed for user `9ac771c30c7349a7ae92b42bfec312da`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:18.294201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.295255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4b897d3b-e2d5-43bd-a2e5-9d7fc3dce5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.309677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1058/2056] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:18 2022] PUT /identity/v3/projects/e014057f36034765ac1778f1d159b209/users/aaaaf64ec45e4855804fce9f6ddd2ff4/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:18.319890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.374940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d8de-bb09-4a00-a211-207cfdef0712 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.379643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 999/2057] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:18.379810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.380547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.380859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.380960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d069-031e-4c71-99be-fe2e12738025 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.381147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] PATH_INFO: `/v3/projects/bc0f1132691e41b48548f0a352fce067/users/c59c3134649c4559bca0433dbee3a5cc/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.381270 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d069-031e-4c71-99be-fe2e12738025 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.381514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d069-031e-4c71-99be-fe2e12738025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.398204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0f1132691e41b48548f0a352fce067, user_id=c59c3134649c4559bca0433dbee3a5cc, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.400885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.411233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-db47d069-031e-4c71-99be-fe2e12738025 None None] MFA Rules not processed for user `aaaaf64ec45e4855804fce9f6ddd2ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:18.412447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-db47d069-031e-4c71-99be-fe2e12738025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.415031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1059/2058] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:18 2022] PUT /identity/v3/projects/bc0f1132691e41b48548f0a352fce067/users/c59c3134649c4559bca0433dbee3a5cc/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:18.416049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.418163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.482368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1000/2059] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:18.482517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0873fc-34cc-453c-97a1-a0001e04b29c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.486638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.487178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.487411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.487880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.488093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.488375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.488725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.490606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.514641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] MFA Rules not processed for user `c59c3134649c4559bca0433dbee3a5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:18.515752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.548850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.550544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.559782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1060/2060] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:18.560439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.561725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:18.573273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151bd7-d491-42fb-bddb-7a572d86ce21 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.577456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.578087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.578367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.578634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.579384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1001/2061] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:18.584182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.591786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.593247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.604023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1061/2062] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:18.646152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28c8d-df59-4b31-a1fd-2a88ab80edcc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.650978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.651634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.651912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.652184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.652900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.654786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.684149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1002/2063] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:18 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:18.688514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.701789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b3e3a-5db5-415e-b6ba-792e71f07d79 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.771659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.772322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.772604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.772910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.773615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.775585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.799535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1062/2064] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:18 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:18.803762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.816023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92262f-a650-42df-85dd-389f692aae0f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.821336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.822020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.822298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.822571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.823314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.824954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.837152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1003/2065] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:18.841472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.858089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3f8d9-4373-443b-8b8d-8ee80a22f656 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.866548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.868850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.868850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.868850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] PATH_INFO: `/v3/projects/7558c76092e94755b7d5b4fa991f9bfe/users/7f53665447954dde9fd937c044d7cec0/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.886218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7558c76092e94755b7d5b4fa991f9bfe, user_id=7f53665447954dde9fd937c044d7cec0, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.889550 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:18.911632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1063/2066] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:18 2022] PUT /identity/v3/projects/7558c76092e94755b7d5b4fa991f9bfe/users/7f53665447954dde9fd937c044d7cec0/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:18.915328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:18.926801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaaf18-4e12-466c-82e5-dad0985dd1ce admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:18.989911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:18.990584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:18.990860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:18.991130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:18.991850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:18.993502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b7492-3852-4aab-acaf-2e330b5a212b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:19.004053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1004/2067] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:19.007516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:19.019109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94e9c-7267-4f46-8fc1-dde436990d7d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:19.024981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:19.025853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:19.026131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:19.026398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] PATH_INFO: `/v3/projects/7558c76092e94755b7d5b4fa991f9bfe/users/7f53665447954dde9fd937c044d7cec0/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:19.028872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7558c76092e94755b7d5b4fa991f9bfe, user_id=7f53665447954dde9fd937c044d7cec0, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:19.032054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:19.045630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1064/2068] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:19 2022] PUT /identity/v3/projects/7558c76092e94755b7d5b4fa991f9bfe/users/7f53665447954dde9fd937c044d7cec0/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:19.060135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:19.060135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:19.060135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:19.087077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] MFA Rules not processed for user `7f53665447954dde9fd937c044d7cec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:19.088299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:19.163691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1005/2069] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:19.175533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:19.228572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62efb0-3031-4a21-85f8-b8a29aeab453 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:19.232155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:19.232824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:19.233105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:19.233380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:19.242393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:19.243807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:19.252997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1065/2070] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:19.323830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:19.333820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c571-f295-45c1-b2b4-0ab9ff6d56ed None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:19.337402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:19.338033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:19.338312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:19.338583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:19.396044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:19.397545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:19.406943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1006/2071] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:21.161602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:21.170201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1699-ba04-4614-937e-acf077dfd4a8 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:21.173811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:21.174454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:21.174847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:21.175353 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:21.177587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:21.247682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:21.249158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:21.259098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1066/2072] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:21.829151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:21.838374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedf604-9712-4c88-b532-648724931178 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:21.841959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:21.842613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:21.842899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:21.843174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:21.908852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:21.910352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a087749-9e59-495e-9d7f-5514ae88c145 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:21.927948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1007/2073] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:30.149132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:30.213673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973799fc-b721-451c-aa2b-9684d7580a20 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:30.218134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:30.219005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:30.219287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:30.219566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] PATH_INFO: `/v3/users/437b2c0efdd047aa9a286885cf3014ce` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:30.220781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=437b2c0efdd047aa9a286885cf3014ce)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:30.223241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:30.272703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437b2c0efdd047aa9a286885cf3014ce'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.279647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437b2c0efdd047aa9a286885cf3014ce'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.280382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437b2c0efdd047aa9a286885cf3014ce'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.289852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437b2c0efdd047aa9a286885cf3014ce'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.290453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437b2c0efdd047aa9a286885cf3014ce'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.308777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1067/2074] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:30 2022] DELETE /identity/v3/users/437b2c0efdd047aa9a286885cf3014ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:30.313322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:30.313805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:30.313902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:30.332585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:30.333900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:30.395311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1008/2075] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:30.405107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:30.406574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:30.464949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274885ce-5e0a-490e-8180-056c48b7ee4f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:30.468524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:30.469186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:30.469462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:30.469728 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:30.478617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:30.480037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:30.490849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1068/2076] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:30.801513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:30.803163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:30.819225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfdba-bbbd-4afb-8893-2f817c6e31a9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:30.825796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:30.826927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:30.827810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:30.828083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] PATH_INFO: `/v3/projects/02d8746568644757a308b2366be64d68` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:30.829576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d8746568644757a308b2366be64d68)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:30.831731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:30.884262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d8746568644757a308b2366be64d68', 'request_id': 'req-16f24c75-8a64-425e-9f95-4306fa922ad9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.889637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d8746568644757a308b2366be64d68', 'request_id': 'req-16f24c75-8a64-425e-9f95-4306fa922ad9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.898555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d8746568644757a308b2366be64d68', 'request_id': 'req-16f24c75-8a64-425e-9f95-4306fa922ad9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.911602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] The token cache is being invalidate because project 02d8746568644757a308b2366be64d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:30.911881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.912518 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:30.914090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1009/2077] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:30 2022] DELETE /identity/v3/projects/02d8746568644757a308b2366be64d68 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:30.918113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:30.928219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc344-ad73-4a67-b5b0-7a7d31e46cb7 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:30.982020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:30.982877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:30.983157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:30.983428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] PATH_INFO: `/v3/users/02d6b0a0dae54ab1b5a1e17cf7974696` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:30.984611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d6b0a0dae54ab1b5a1e17cf7974696)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:30.986552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:31.031556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d6b0a0dae54ab1b5a1e17cf7974696'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.039074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d6b0a0dae54ab1b5a1e17cf7974696'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.039736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d6b0a0dae54ab1b5a1e17cf7974696'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.047315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d6b0a0dae54ab1b5a1e17cf7974696'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.047646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d6b0a0dae54ab1b5a1e17cf7974696'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.068803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1069/2078] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:30 2022] DELETE /identity/v3/users/02d6b0a0dae54ab1b5a1e17cf7974696 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:31.408067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:31.410634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:31.428079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f24c75-8a64-425e-9f95-4306fa922ad9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:31.488416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:31.489318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:31.489660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:31.489993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] PATH_INFO: `/v3/projects/f5bcf7e296c94f5da88dac23b5d9ffdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:31.491451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bcf7e296c94f5da88dac23b5d9ffdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:31.496563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:31.545203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bcf7e296c94f5da88dac23b5d9ffdc', 'request_id': 'req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.551200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bcf7e296c94f5da88dac23b5d9ffdc', 'request_id': 'req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.558363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bcf7e296c94f5da88dac23b5d9ffdc', 'request_id': 'req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.570701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] The token cache is being invalidate because project f5bcf7e296c94f5da88dac23b5d9ffdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:31.571421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.572101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.573985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1010/2079] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:31 2022] DELETE /identity/v3/projects/f5bcf7e296c94f5da88dac23b5d9ffdc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:31.577669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:31.579050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:31.590833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:31.592224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:31.593316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6853fb-ddbe-4561-8adc-c07efdf85f11 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:31.652557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:31.653457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:31.653912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:31.654191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] PATH_INFO: `/v3/users/9ac771c30c7349a7ae92b42bfec312da` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:31.655380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac771c30c7349a7ae92b42bfec312da)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:31.657755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:31.657897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ad1a-2f7a-4444-b7aa-90d25a0a14df admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:31.663222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:31.664039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:31.664264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:31.664539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] PATH_INFO: `/v3/users/c59c3134649c4559bca0433dbee3a5cc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:31.665790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59c3134649c4559bca0433dbee3a5cc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:31.667698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:31.711464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac771c30c7349a7ae92b42bfec312da'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.719202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac771c30c7349a7ae92b42bfec312da'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.719884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac771c30c7349a7ae92b42bfec312da'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.720687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59c3134649c4559bca0433dbee3a5cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.728544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac771c30c7349a7ae92b42bfec312da'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.729336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-11d22c1e-d398-431f-b57d-e3ab27db907f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac771c30c7349a7ae92b42bfec312da'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.731119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59c3134649c4559bca0433dbee3a5cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.739669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59c3134649c4559bca0433dbee3a5cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.740510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59c3134649c4559bca0433dbee3a5cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.741319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59c3134649c4559bca0433dbee3a5cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:31.750156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1070/2080] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:31 2022] DELETE /identity/v3/users/9ac771c30c7349a7ae92b42bfec312da => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:31.759413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1011/2081] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:31 2022] DELETE /identity/v3/users/c59c3134649c4559bca0433dbee3a5cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:31.766325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:31.766615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:31.766900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:31.785640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:31.786847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:31.847413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1071/2082] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:31.857333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:31.858789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:31.927788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06209cb-3134-4923-9969-44cf9f5c86dc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:31.932308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:31.933411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:31.933694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:31.933984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:31.945674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:31.947252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:31.958629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1012/2083] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:32.124307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:32.126861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:32.140916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3dc34-3c8f-468e-ba01-c9a3a257d4da None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:32.147375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:32.148400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:32.148617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:32.149049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] PATH_INFO: `/v3/projects/87e06355164840119f89dbab6e514f11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:32.151208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e06355164840119f89dbab6e514f11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:32.153936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:32.205548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e06355164840119f89dbab6e514f11', 'request_id': 'req-c485aa54-b854-4cbc-895f-fb9b705fad2a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.211324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e06355164840119f89dbab6e514f11', 'request_id': 'req-c485aa54-b854-4cbc-895f-fb9b705fad2a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.221671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e06355164840119f89dbab6e514f11', 'request_id': 'req-c485aa54-b854-4cbc-895f-fb9b705fad2a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.234088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] The token cache is being invalidate because project 87e06355164840119f89dbab6e514f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:32.234389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.235392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.237729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1072/2084] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:32 2022] DELETE /identity/v3/projects/87e06355164840119f89dbab6e514f11 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:32.368343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:32.369838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:32.398735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50822d-58db-4826-87e9-febce9c6fac0 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:32.467180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:32.468097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:32.468382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:32.468749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] PATH_INFO: `/v3/projects/bc0f1132691e41b48548f0a352fce067` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:32.469894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0f1132691e41b48548f0a352fce067)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:32.471846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:32.517390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0f1132691e41b48548f0a352fce067', 'request_id': 'req-a88d7726-f86e-4c1a-b810-a201b22cc916'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.523240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0f1132691e41b48548f0a352fce067', 'request_id': 'req-a88d7726-f86e-4c1a-b810-a201b22cc916'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.530870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0f1132691e41b48548f0a352fce067', 'request_id': 'req-a88d7726-f86e-4c1a-b810-a201b22cc916'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.541996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] The token cache is being invalidate because project bc0f1132691e41b48548f0a352fce067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:32.542284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.542957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.544535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1013/2085] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:32 2022] DELETE /identity/v3/projects/bc0f1132691e41b48548f0a352fce067 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:32.548667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:32.550172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:32.562663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485aa54-b854-4cbc-895f-fb9b705fad2a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:32.618825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:32.619689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:32.619970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:32.620241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] PATH_INFO: `/v3/users/7f53665447954dde9fd937c044d7cec0` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:32.621440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f53665447954dde9fd937c044d7cec0)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:32.623340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:32.667006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f53665447954dde9fd937c044d7cec0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.673532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f53665447954dde9fd937c044d7cec0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.674612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f53665447954dde9fd937c044d7cec0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.681433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f53665447954dde9fd937c044d7cec0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.682226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-464faba3-e505-411a-a897-f568ce340b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f53665447954dde9fd937c044d7cec0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.699368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1073/2086] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:32 2022] DELETE /identity/v3/users/7f53665447954dde9fd937c044d7cec0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:32.782124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:32.784220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:32.796581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7726-f86e-4c1a-b810-a201b22cc916 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:32.856752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:32.857642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:32.857958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:32.858235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] PATH_INFO: `/v3/users/aaaaf64ec45e4855804fce9f6ddd2ff4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:32.859442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaaaf64ec45e4855804fce9f6ddd2ff4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:32.861410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:32.910279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaaaf64ec45e4855804fce9f6ddd2ff4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.918061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaaaf64ec45e4855804fce9f6ddd2ff4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.925644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaaaf64ec45e4855804fce9f6ddd2ff4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.926319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaaaf64ec45e4855804fce9f6ddd2ff4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.926928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaaaf64ec45e4855804fce9f6ddd2ff4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:32.944259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1014/2087] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:32 2022] DELETE /identity/v3/users/aaaaf64ec45e4855804fce9f6ddd2ff4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:32.949232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:32.949525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:32.949805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:32.969307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:32.971486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:32.974862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:32.976416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.036128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1074/2088] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:33.047677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.049860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc36d-f420-476c-b7ae-8644aaca3408 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.050164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.057147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.058025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.058305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.058630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] PATH_INFO: `/v3/projects/7558c76092e94755b7d5b4fa991f9bfe` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.060709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7558c76092e94755b7d5b4fa991f9bfe)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.062817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.119056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7558c76092e94755b7d5b4fa991f9bfe', 'request_id': 'req-eabafd61-1baf-428b-a3e3-357164e7b1e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.119246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b0db-46f2-4dec-b8f8-7550b2667f4f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.124222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7558c76092e94755b7d5b4fa991f9bfe', 'request_id': 'req-eabafd61-1baf-428b-a3e3-357164e7b1e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.132576 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7558c76092e94755b7d5b4fa991f9bfe', 'request_id': 'req-eabafd61-1baf-428b-a3e3-357164e7b1e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.144350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] The token cache is being invalidate because project 7558c76092e94755b7d5b4fa991f9bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:33.144694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.145405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eabafd61-1baf-428b-a3e3-357164e7b1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.147502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1015/2089] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:32 2022] DELETE /identity/v3/projects/7558c76092e94755b7d5b4fa991f9bfe => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:33.152402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909422-ebac-44a9-8436-20e6595731c7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.152531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909422-ebac-44a9-8436-20e6595731c7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.152882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909422-ebac-44a9-8436-20e6595731c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.172149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a0909422-ebac-44a9-8436-20e6595731c7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:33.172376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.173070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.173354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.173631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.174005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a0909422-ebac-44a9-8436-20e6595731c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.176828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.231001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1016/2090] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:33.239279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.239564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.239838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.240540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.242006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.251654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1075/2091] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:15:33.259451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:33.260678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.270421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1017/2092] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:33.274676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.285371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8b160-ab35-43fa-bcf3-e7241da31f6a service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.290133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.290857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.291144 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.291553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.292297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:33.292672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.294609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.309400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1076/2093] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:15:33.312429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.322609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72bd99-69f5-4a05-a62f-a35368d61234 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.327406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.328065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.328347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.328621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.329346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.332151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.357827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1018/2094] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:33.363174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.373547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278efa9-863a-42a2-8d16-8936c68839fe admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.437767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.438365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.438656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.438929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.439633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.442802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.465842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1077/2095] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:33.470113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.480933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e0a2-3348-40cf-863f-49a5ce026027 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.485750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.486439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.487269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.488487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.488487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.490099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.514235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1019/2096] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:33.518643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.529709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114bde-c43e-4c6a-9f38-195bb2bb1a08 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.535113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.536013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.536374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.536739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.537533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.537667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.539357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.540340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.552245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1078/2097] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:33.556803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.567745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f30f-51b1-4e4d-aa26-29665a9f0b86 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.569098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82a22-ae8e-4aa8-8d59-2d015b5f90a3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.573522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.574480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.574830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.575106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.575236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] PATH_INFO: `/v3/projects/e6e31340e64740959d42d891b5958586/users/3c4bbd45cce648d5b71d81650f73f15f/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.576015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.576341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.576758 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] PATH_INFO: `/v3/projects/e014057f36034765ac1778f1d159b209` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.577979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e014057f36034765ac1778f1d159b209)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.579966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.591986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e31340e64740959d42d891b5958586, user_id=3c4bbd45cce648d5b71d81650f73f15f, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.594894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b3e9a-948c-4567-922e-3f66d2ce11bf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.612076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1079/2098] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:33 2022] PUT /identity/v3/projects/e6e31340e64740959d42d891b5958586/users/3c4bbd45cce648d5b71d81650f73f15f/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:33.622940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.623570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.623570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.642397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e014057f36034765ac1778f1d159b209', 'request_id': 'req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.649509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e014057f36034765ac1778f1d159b209', 'request_id': 'req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.651806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] MFA Rules not processed for user `3c4bbd45cce648d5b71d81650f73f15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:33.653109 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.658251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e014057f36034765ac1778f1d159b209', 'request_id': 'req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.670876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] The token cache is being invalidate because project e014057f36034765ac1778f1d159b209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:33.671173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.671840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:33.674217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1020/2099] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:33 2022] DELETE /identity/v3/projects/e014057f36034765ac1778f1d159b209 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:33.742075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1080/2100] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:33.746595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.748088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:33.817870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffab4-9e6a-4d16-b70c-fef5ba2acb09 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.822848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.823538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.823816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.824089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.824847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.826816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.854143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1021/2101] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:33.858055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.869131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239ec78-5f7d-41c5-9646-c0e3398939c9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.923491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.924807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.925093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.925366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.926057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.927962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.948317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1081/2102] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:33 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:33.952277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.963005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667dc50-6f09-4137-b6d4-2a86cd59281f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.967461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:33.968114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:33.968392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:33.968694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:33.969422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:33.971032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:33.981525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1022/2103] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:33.985343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:33.995185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765e6e-4f9f-490a-82c3-a2249f287ee0 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:33.999671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:34.000531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.000864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.001120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] PATH_INFO: `/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e/users/87253ff894714ab2b499d572f8e8d638/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.015961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ec2c108d6749e6a0cd6295c1bd453e, user_id=87253ff894714ab2b499d572f8e8d638, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:34.019341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:34.032018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1082/2104] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:33 2022] PUT /identity/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e/users/87253ff894714ab2b499d572f8e8d638/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:34.036043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:34.045664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a504-88ab-43b0-85c6-bd77dcd9063a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:34.099998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:34.100673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.100963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.101237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.101955 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:34.103718 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eae828-9dd9-4bb8-9097-09e7e9d535cd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:34.113608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1023/2105] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:34.117733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:34.128264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e27d-ed27-49c2-b9bf-d43bbdc8cc27 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:34.132788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:34.133641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.133917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.134187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] PATH_INFO: `/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e/users/87253ff894714ab2b499d572f8e8d638/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.136102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ec2c108d6749e6a0cd6295c1bd453e, user_id=87253ff894714ab2b499d572f8e8d638, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:34.138871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:34.148973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1083/2106] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:34 2022] PUT /identity/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e/users/87253ff894714ab2b499d572f8e8d638/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:34.160670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.160998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.161271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.190532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] MFA Rules not processed for user `87253ff894714ab2b499d572f8e8d638`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:34.191723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:34.262216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1024/2107] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:34.275387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:34.277286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:34.338167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d2923-aff2-4336-8a53-225770d76838 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:34.341724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:34.342356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.342631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.342910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.352100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:34.353648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:34.363662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1084/2108] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:34.435855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:34.445759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecefcb4-ddcd-43f3-97a0-f86c1df2b3d9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:34.449229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:34.449909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:34.450186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:34.450454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:34.511065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:34.512418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ae5e4-ffac-4474-bbc4-0bb3fa3d18e3 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:34.521583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1025/2109] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:35.317896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:35.319286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:35.382156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822718a-9507-4830-8b6b-5c837aabd474 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:35.386525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:35.387375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:35.387652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:35.387922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] PATH_INFO: `/v3/users/4b40b70c25a74aa5a73db8e498521333` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:35.389110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b40b70c25a74aa5a73db8e498521333)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:35.390993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:35.435437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b40b70c25a74aa5a73db8e498521333'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:35.442097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b40b70c25a74aa5a73db8e498521333'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:35.442760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b40b70c25a74aa5a73db8e498521333'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:35.449844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b40b70c25a74aa5a73db8e498521333'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:35.450504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b40b70c25a74aa5a73db8e498521333'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:35.467694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1085/2110] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:35 2022] DELETE /identity/v3/users/4b40b70c25a74aa5a73db8e498521333 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:35.473050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:35.473358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:35.473629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:35.490704 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:35.491875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:35.548854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1026/2111] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:35.559147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:35.560534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:35.616915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b327-6583-4306-9081-93f09a538f42 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:35.620448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:35.621119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:35.621399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:35.621672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:35.630980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:35.632386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cdcb-91c2-458e-8ecd-bd7d04f90c10 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:35.641489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1086/2112] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:35.935083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:35.936456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:35.950941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab95e-ed95-4692-bfd2-3368cc6817be None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:35.956256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:35.957293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:35.957633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:35.957987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] PATH_INFO: `/v3/projects/faf3dd7fdd1241749cdbc51654877eec` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:35.959350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf3dd7fdd1241749cdbc51654877eec)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:35.961630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.016095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf3dd7fdd1241749cdbc51654877eec', 'request_id': 'req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:36.022521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf3dd7fdd1241749cdbc51654877eec', 'request_id': 'req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:36.031332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf3dd7fdd1241749cdbc51654877eec', 'request_id': 'req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:36.044795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] The token cache is being invalidate because project faf3dd7fdd1241749cdbc51654877eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:36.045638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:36.046467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b81af81d-7a71-43d4-a9e3-ebc2706d0be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:36.051796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1027/2113] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:35 2022] DELETE /identity/v3/projects/faf3dd7fdd1241749cdbc51654877eec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:36.053398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.053818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.054219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.074544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:36.075713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:36.142007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1087/2114] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:36.150283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.150585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.150848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.169865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:36.171033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:36.179823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1028/2115] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:36.184043 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.195090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbd4c6-402f-476a-aaae-a8ee74f6565e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.199837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.200485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.200795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.201067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.201788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:36.202090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.203658 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.216579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1088/2116] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:36.221052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.231581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afb010-e48e-4fae-923b-0f77b4f254ea None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.236392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.237085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.238560 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.238699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.239337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.241269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.267852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1029/2117] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:36 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:36.273072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.283092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b441-0725-4c61-ad8a-dbefaa358d45 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.338436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.339152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.339375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.339650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.340352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.342292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.361702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1089/2118] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:36 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:36.366384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.376524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa11e-c7cf-4d38-9eea-f42653980f3e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.382007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.382656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.382938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.383209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.383937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.385563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.395884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1030/2119] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:36.399652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.409773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083dc0-7ae4-4144-af4e-6e88afb9dd1c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.414356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.414992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.415270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.415542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.416310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.417920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3041fe-b0f5-4957-a89d-6b1cb53b4a26 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.427969 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1090/2120] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:36.431872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.442256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf39085-672d-41e0-9d32-e27f7b9ecd9b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.446792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.447655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.447935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.448211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] PATH_INFO: `/v3/projects/faded7bb73c24fe4abccb4b27a3782f6/users/9ce8542c47d74e619454c936e25e93a4/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.462920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faded7bb73c24fe4abccb4b27a3782f6, user_id=9ce8542c47d74e619454c936e25e93a4, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.465670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.477470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1031/2121] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:36 2022] PUT /identity/v3/projects/faded7bb73c24fe4abccb4b27a3782f6/users/9ce8542c47d74e619454c936e25e93a4/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:36.488240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.488583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.488841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.514367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] MFA Rules not processed for user `9ce8542c47d74e619454c936e25e93a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:36.515539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:36.576841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1091/2122] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:36.588878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:36.590562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:36.645215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2e8f5-a679-4a46-bab3-2c8a0ee17a65 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:36.648677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:36.649312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:36.649587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:36.649857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:36.658079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:36.660287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2afb3-89df-458e-ad42-667f0d51ab26 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:36.668703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1032/2123] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:37.290833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:37.292286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:37.355456 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa1cb4-2883-4498-9666-7eae76c4e4d4 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:37.359878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:37.361022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:37.361300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:37.361604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] PATH_INFO: `/v3/users/3c4bbd45cce648d5b71d81650f73f15f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:37.362794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4bbd45cce648d5b71d81650f73f15f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:37.364929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:37.412226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4bbd45cce648d5b71d81650f73f15f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.418980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4bbd45cce648d5b71d81650f73f15f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.419644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4bbd45cce648d5b71d81650f73f15f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.427960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4bbd45cce648d5b71d81650f73f15f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.428587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4bbd45cce648d5b71d81650f73f15f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.447532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1092/2124] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:37 2022] DELETE /identity/v3/users/3c4bbd45cce648d5b71d81650f73f15f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:37.452373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:37.452681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:37.452971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:37.471810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:37.473656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:37.533151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1033/2125] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:37.543256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:37.544637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:37.603601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fef2-e9ef-4edb-bc8a-7b63b3964f95 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:37.607262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:37.607906 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:37.608189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:37.608462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:37.617604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:37.619018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:37.628179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1093/2126] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:37.896493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:37.897062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:37.909107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d9c84-b01f-4a93-b1ef-26f09aabe2ba None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:37.914094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:37.915038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:37.915609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:37.916000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] PATH_INFO: `/v3/projects/e6e31340e64740959d42d891b5958586` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:37.917433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e31340e64740959d42d891b5958586)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:37.919593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:37.967769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e31340e64740959d42d891b5958586', 'request_id': 'req-0c98f690-efa4-4d84-b660-67ea9dc22513'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.974026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e31340e64740959d42d891b5958586', 'request_id': 'req-0c98f690-efa4-4d84-b660-67ea9dc22513'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.981502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e31340e64740959d42d891b5958586', 'request_id': 'req-0c98f690-efa4-4d84-b660-67ea9dc22513'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.992934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] The token cache is being invalidate because project e6e31340e64740959d42d891b5958586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:37.993218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.993878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:37.995443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1034/2127] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:37 2022] DELETE /identity/v3/projects/e6e31340e64740959d42d891b5958586 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:37.999510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.009395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513a63-e142-41cd-9a50-363b77245365 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.067589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.068462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.068772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.069045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] PATH_INFO: `/v3/users/87253ff894714ab2b499d572f8e8d638` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.070241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87253ff894714ab2b499d572f8e8d638)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.072146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.125814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87253ff894714ab2b499d572f8e8d638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.132426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87253ff894714ab2b499d572f8e8d638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.133117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87253ff894714ab2b499d572f8e8d638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.140244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87253ff894714ab2b499d572f8e8d638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.140886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9550f4e3-b0d3-49cd-8eb7-b25901562cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87253ff894714ab2b499d572f8e8d638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.159531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1094/2128] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:37 2022] DELETE /identity/v3/users/87253ff894714ab2b499d572f8e8d638 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:38.451981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.453482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:38.470163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f690-efa4-4d84-b660-67ea9dc22513 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.529402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.530207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.530487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.530811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] PATH_INFO: `/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.532262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ec2c108d6749e6a0cd6295c1bd453e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.534228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.580316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ec2c108d6749e6a0cd6295c1bd453e', 'request_id': 'req-bfc81a5d-01c6-402f-9244-8d60d6dfade3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.586196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ec2c108d6749e6a0cd6295c1bd453e', 'request_id': 'req-bfc81a5d-01c6-402f-9244-8d60d6dfade3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.593330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ec2c108d6749e6a0cd6295c1bd453e', 'request_id': 'req-bfc81a5d-01c6-402f-9244-8d60d6dfade3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.605508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] The token cache is being invalidate because project 88ec2c108d6749e6a0cd6295c1bd453e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:38.605793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.606431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bfc81a5d-01c6-402f-9244-8d60d6dfade3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:38.607970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1035/2129] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:38 2022] DELETE /identity/v3/projects/88ec2c108d6749e6a0cd6295c1bd453e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:38.612877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.614472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.614472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.632769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:38.633944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:38.695037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1095/2130] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:38.702780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.703092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.703367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.722551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:38.723752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:38.731483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1036/2131] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:38.735754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.745859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02d76c-b611-41fe-9a7d-53726a78571b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.750394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.751040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.751319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.751663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.752348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:38.752644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.755231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.766968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1096/2132] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:38.771338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.780485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138dfa2-8dc8-42fa-b068-05a779e32fc4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.785528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.786169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.786452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.786722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.787421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.789388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.815119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1037/2133] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:38 2022] POST /identity/v3/projects => generated 407 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:38.819719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.829562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8eb2-f2ed-4669-a878-2dad0cd49304 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.885599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.886265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.886544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.886815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.887517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.889439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.913491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1097/2134] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:38 2022] POST /identity/v3/users => generated 304 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:38.917607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.927860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca4879-743d-4b4c-ae5a-9206ca9c1f48 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.932432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.933119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.933395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.933665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.934390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.936025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.948312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1038/2135] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:38.952221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.962729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a638b6-2829-4d5b-b832-555bf41e375d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:38.967453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:38.968098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:38.968375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:38.968738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:38.969392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:38.970974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c973b8d-440e-4d9f-bf01-8dd5d9042134 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:38.981417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1098/2136] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:38.985590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:38.995695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec58-4a2a-41f8-8e25-135aabcc3f3b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.000222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.001103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.001404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.001675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] PATH_INFO: `/v3/projects/edd668cfdd65411fa68f2a373d28068e/users/48330f3c43c048b5893ab0f138687e91/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.017505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd668cfdd65411fa68f2a373d28068e, user_id=48330f3c43c048b5893ab0f138687e91, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.020809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.033693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1039/2137] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:38 2022] PUT /identity/v3/projects/edd668cfdd65411fa68f2a373d28068e/users/48330f3c43c048b5893ab0f138687e91/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:39.045035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.045321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.045636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.076206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] MFA Rules not processed for user `48330f3c43c048b5893ab0f138687e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:39.077445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:39.139696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1099/2138] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:39.144177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.207742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ded91-1bf7-4546-8137-7fb0b0a1b442 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.212391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.213075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.213357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.213631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.214316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.216207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.245728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1040/2139] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:39 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:39.247342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.258981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b704b-fe52-4dfa-8791-ea1fe3b792c2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.315868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.316512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.316841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.317131 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.317813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.319708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.340122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1100/2140] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:39 2022] POST /identity/v3/users => generated 310 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:39.344097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.355781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ccbf4-98c8-47e8-a41b-77fdc86528b9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.360290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.360971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.361248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.361515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.362224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.364245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.375262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1041/2141] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:39.379439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.388963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872edd-ed93-4c63-a10c-764181c8f977 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.393462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.394851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.395146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.395460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] PATH_INFO: `/v3/projects/382ac721742f4152819555ad5549be7b/users/ef4662e43db04248afeb273f3126019b/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.410806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382ac721742f4152819555ad5549be7b, user_id=ef4662e43db04248afeb273f3126019b, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.413520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.426418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1101/2142] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:39 2022] PUT /identity/v3/projects/382ac721742f4152819555ad5549be7b/users/ef4662e43db04248afeb273f3126019b/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:39.430464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.441259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002536bf-ba00-4cc0-81eb-e76877830491 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.500779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.501453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.501731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.502125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.502866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.505180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffce029-eb6c-4b5e-b9b5-70636e63d28c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.515232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1042/2143] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:39.519220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.529382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5cd05-ce47-4ea9-a820-269aa8072664 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.534682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.535575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.536035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.536226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] PATH_INFO: `/v3/projects/382ac721742f4152819555ad5549be7b/users/ef4662e43db04248afeb273f3126019b/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.538348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382ac721742f4152819555ad5549be7b, user_id=ef4662e43db04248afeb273f3126019b, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.541068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.552256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1102/2144] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:39 2022] PUT /identity/v3/projects/382ac721742f4152819555ad5549be7b/users/ef4662e43db04248afeb273f3126019b/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:39.562181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.562466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.562746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.590988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] MFA Rules not processed for user `ef4662e43db04248afeb273f3126019b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:39.592190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:39.659541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1043/2145] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:39.670938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.672836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:39.729903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0254-efb3-47e5-a6a2-5c92cce9eec9 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.733526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.734157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.734440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.734709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.743351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.744785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.754546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1103/2146] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:39.895607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:39.906006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce5d6-409a-4435-b506-9608464d8f43 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:39.910255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:39.910906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:39.911191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:39.911465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:39.968167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:39.969642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8712c-8976-487b-91dc-44089fa38759 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:39.978915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1044/2147] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:48.318312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:48.384710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb4a6-0b86-489a-b6ee-d930541af8e6 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:48.389215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:48.390070 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:48.390346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:48.390612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] PATH_INFO: `/v3/users/48330f3c43c048b5893ab0f138687e91` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:48.391787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48330f3c43c048b5893ab0f138687e91)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:48.393747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:48.439325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48330f3c43c048b5893ab0f138687e91'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.447329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48330f3c43c048b5893ab0f138687e91'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.448052 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48330f3c43c048b5893ab0f138687e91'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.455409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48330f3c43c048b5893ab0f138687e91'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.456038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48330f3c43c048b5893ab0f138687e91'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.473731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1104/2148] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:48 2022] DELETE /identity/v3/users/48330f3c43c048b5893ab0f138687e91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:48.478485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:48.478964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:48.479076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:48.498299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:48.499485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:48.558021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1045/2149] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:48.567758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:48.569175 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:48.629275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359b52-5ebe-40b4-9841-3feaa7301127 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:48.633754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:48.634395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:48.634669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:48.634960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:48.644079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:48.645515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:48.655213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1105/2150] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:48.916385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:48.917815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:48.932179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4e944-d65e-4d2d-9c5a-3cc71455f39a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:48.936641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:48.938275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:48.938551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:48.938876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] PATH_INFO: `/v3/projects/edd668cfdd65411fa68f2a373d28068e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:48.939990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd668cfdd65411fa68f2a373d28068e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:48.941916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:48.987376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd668cfdd65411fa68f2a373d28068e', 'request_id': 'req-5b2016e3-5ccc-453c-8178-2477139162d5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.993230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd668cfdd65411fa68f2a373d28068e', 'request_id': 'req-5b2016e3-5ccc-453c-8178-2477139162d5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:48.999995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd668cfdd65411fa68f2a373d28068e', 'request_id': 'req-5b2016e3-5ccc-453c-8178-2477139162d5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.010991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] The token cache is being invalidate because project edd668cfdd65411fa68f2a373d28068e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:49.011269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.011872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.013413 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1046/2151] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:48 2022] DELETE /identity/v3/projects/edd668cfdd65411fa68f2a373d28068e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:49.017544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.026842 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460de7-6659-41d3-af3c-8b54d932991d service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.084053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.084980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.085320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.085641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] PATH_INFO: `/v3/users/ef4662e43db04248afeb273f3126019b` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.086992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4662e43db04248afeb273f3126019b)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.089756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.134173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4662e43db04248afeb273f3126019b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.140721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4662e43db04248afeb273f3126019b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.141405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4662e43db04248afeb273f3126019b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.148821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4662e43db04248afeb273f3126019b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.149421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-82e14411-2436-451c-bf79-9a3333e5c120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4662e43db04248afeb273f3126019b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.166596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1106/2152] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:49 2022] DELETE /identity/v3/users/ef4662e43db04248afeb273f3126019b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:49.468571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.470001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:49.485417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2016e3-5ccc-453c-8178-2477139162d5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.546919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.547777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.548050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.548317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] PATH_INFO: `/v3/projects/382ac721742f4152819555ad5549be7b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.549523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382ac721742f4152819555ad5549be7b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.551420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.597408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382ac721742f4152819555ad5549be7b', 'request_id': 'req-f1c710bf-809a-40e3-b150-fd05b470dda4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.602618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382ac721742f4152819555ad5549be7b', 'request_id': 'req-f1c710bf-809a-40e3-b150-fd05b470dda4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.610535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382ac721742f4152819555ad5549be7b', 'request_id': 'req-f1c710bf-809a-40e3-b150-fd05b470dda4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.621339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] The token cache is being invalidate because project 382ac721742f4152819555ad5549be7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:49.621619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.622244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f1c710bf-809a-40e3-b150-fd05b470dda4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:49.627768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1047/2153] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:49 2022] DELETE /identity/v3/projects/382ac721742f4152819555ad5549be7b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:49.629826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.630257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.630753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.653615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:49.654852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:49.718886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1107/2154] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:49.727111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.727493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.727843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.747229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:49.748426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:49.756443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1048/2155] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:49.760790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.771189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab95e-0020-41d8-979d-4773668cb036 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.777077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.777729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.778006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.778279 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.779031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:49.779335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.780941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.796469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1108/2156] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:49.801196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.811434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af3839-03ec-43b6-b934-de719e3a83b5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.816165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.816844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.817124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.817394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.818087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.820552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.846183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1049/2157] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:49.850100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.859991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5749e-00e1-4c7a-b139-7df940c849b4 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.915823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.916496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.916812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.917084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.917777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.919704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.942972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1109/2158] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:49 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:49.944134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.955106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee1cf-35da-49c5-b6c8-379e0f4c8f22 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.959678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.960410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.960766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.960995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.961717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.963316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:49.974634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1050/2159] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:49.978501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:49.988481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525b4-a665-478e-a11d-529d8689ff72 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:49.993891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:49.994547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:49.994858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:49.995155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:49.995898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:49.997509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e0a73-17df-48b2-a39e-cf308c5e270e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.007261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1110/2160] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:50.011561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:50.021728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec3714-4502-4390-9ce3-8c8e3a4c99e5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:50.027115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:50.028011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.028348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.028615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] PATH_INFO: `/v3/projects/d754daf034de4a779d0d6da45896e8cf/users/11d951ead39349c6b1f6af6b8b6d0790/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.044552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d754daf034de4a779d0d6da45896e8cf, user_id=11d951ead39349c6b1f6af6b8b6d0790, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:50.047271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.061064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1051/2161] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:50 2022] PUT /identity/v3/projects/d754daf034de4a779d0d6da45896e8cf/users/11d951ead39349c6b1f6af6b8b6d0790/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:50.072934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.073309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.073596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.103147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] MFA Rules not processed for user `11d951ead39349c6b1f6af6b8b6d0790`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:50.104359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:50.167358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1111/2162] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:15:50.178534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:50.180357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:50.235140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2385d9-898c-42ee-be9d-76f9feb769e5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:50.238720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:50.239352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.239628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.239897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.248568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:50.250011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2aefd-1cf7-41a9-b370-a18dea114420 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.258869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1052/2163] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:50.278048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:50.339068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52038a-d1f4-492f-bc8c-3bd265fc4527 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:50.343650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:50.344509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.344823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.345102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] PATH_INFO: `/v3/users/11d951ead39349c6b1f6af6b8b6d0790` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.346295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d951ead39349c6b1f6af6b8b6d0790)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:50.348198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.394116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d951ead39349c6b1f6af6b8b6d0790'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.400742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d951ead39349c6b1f6af6b8b6d0790'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.401414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d951ead39349c6b1f6af6b8b6d0790'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.408448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d951ead39349c6b1f6af6b8b6d0790'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.409158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d951ead39349c6b1f6af6b8b6d0790'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.425752 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1112/2164] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:15:50 2022] DELETE /identity/v3/users/11d951ead39349c6b1f6af6b8b6d0790 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:15:50.430907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.431186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.431489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.448282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:50.449562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:50.507400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1053/2165] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:50.516864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:50.518244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:50.573630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e69d-4d8f-4c7d-ab6e-297475d51a58 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:50.577248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:50.577891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.578174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.578450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.587896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:50.589337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e2cd-d22f-4fd4-a7a9-d3b24132388c service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.598622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1113/2166] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:50.859058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:50.860463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:50.873862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f35d0-6743-47a1-8b95-242fca88fada None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:50.878705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:50.879654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.880093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.880366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] PATH_INFO: `/v3/projects/d754daf034de4a779d0d6da45896e8cf` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.881579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d754daf034de4a779d0d6da45896e8cf)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:50.883708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:50.930208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd754daf034de4a779d0d6da45896e8cf', 'request_id': 'req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.935299 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd754daf034de4a779d0d6da45896e8cf', 'request_id': 'req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.942034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd754daf034de4a779d0d6da45896e8cf', 'request_id': 'req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.953117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] The token cache is being invalidate because project d754daf034de4a779d0d6da45896e8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:50.953395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.954001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8e5a5608-6f3f-4406-920c-ed0ba3ef9416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:50.955529 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1054/2167] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:15:50 2022] DELETE /identity/v3/projects/d754daf034de4a779d0d6da45896e8cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:50.960485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:50.961048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:50.961170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:50.978762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:50.979935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:51.036000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1114/2168] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:51.044283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.044574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.044897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.063649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:51.064876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:51.072885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1055/2169] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:51.077099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.086687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89ef6-dafd-4183-ba96-5b8d7fd0ee47 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.091182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.091837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.092115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.092390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.093152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:51.093458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.095044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.107039 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1115/2170] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:51.110977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.121054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656596-0ad8-43ac-bc74-71e1335590eb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.125869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.126522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.126848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.127119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.127954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.129881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.157885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1056/2171] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:15:51 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:51.162081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.173201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6236-c29d-410b-b6cf-ab299870abb3 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.229210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.229851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.230128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.230399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.231155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.233029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.252026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1116/2172] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:15:51 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:51.256255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.266338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4fe72-1250-4ebc-8809-1e9ae2837e20 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.271259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.271912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.272187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.272455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.273814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.275397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.285848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1057/2173] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:51.290648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.300244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db465-7d1d-4b6d-93f7-04aadbc59001 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.304962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.305607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.305890 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.306167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.306885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.308477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3c20a-2038-4ab3-bfe0-971324332b45 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.318010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1117/2174] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:51.321937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.331424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aedb-b5ea-4533-aacd-9640b6c7a63f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.336777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.337637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.337914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.338184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] PATH_INFO: `/v3/projects/60f8589ccc154b698c08c9ae6000b92e/users/c343182e346f4f45b5cba6e50e24ebe4/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.353061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f8589ccc154b698c08c9ae6000b92e, user_id=c343182e346f4f45b5cba6e50e24ebe4, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.355694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.368860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1058/2175] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:15:51 2022] PUT /identity/v3/projects/60f8589ccc154b698c08c9ae6000b92e/users/c343182e346f4f45b5cba6e50e24ebe4/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:51.379031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.379321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.379626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.405965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] MFA Rules not processed for user `c343182e346f4f45b5cba6e50e24ebe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:51.407404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:51.468576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1118/2176] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:51.480519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:51.482319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:51.536646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd462d-c9fc-40d4-962e-21f6d0d4235d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:51.541318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:51.541890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:51.542170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:51.542443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:51.550501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:51.552340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f58b0-35ba-453e-8ceb-9663a9176c73 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:51.561617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1059/2177] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:15:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:11.659199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:11.660605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:11.723209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7aefb-80d0-4882-b993-a41acef675e3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:11.728473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:11.729391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:11.729676 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:11.730098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] PATH_INFO: `/v3/users/9ce8542c47d74e619454c936e25e93a4` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:11.731304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce8542c47d74e619454c936e25e93a4)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:11.733267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:11.782072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce8542c47d74e619454c936e25e93a4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:11.789451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce8542c47d74e619454c936e25e93a4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:11.790454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce8542c47d74e619454c936e25e93a4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:11.799202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce8542c47d74e619454c936e25e93a4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:11.799826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce8542c47d74e619454c936e25e93a4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:11.821472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1119/2178] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:16:11 2022] DELETE /identity/v3/users/9ce8542c47d74e619454c936e25e93a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:11.823347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:11.823812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:11.823890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:11.858217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:11.860153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:11.946735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1060/2179] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:11.953716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:11.955253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:12.033770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153812-fae6-448b-ab09-8fd61d63d38f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:12.040033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:12.040723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.041023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.041300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.059015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:12.060500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c16fc6-f58d-4bbf-b452-27563fc1e94a service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:12.071901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1120/2180] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:12.533242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:12.534721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:12.550245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48f07-852b-4759-8ef3-7f2a1a7bb007 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:12.554786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:12.555648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.555923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.556191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] PATH_INFO: `/v3/projects/faded7bb73c24fe4abccb4b27a3782f6` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.557389 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faded7bb73c24fe4abccb4b27a3782f6)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:12.559277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:12.604869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faded7bb73c24fe4abccb4b27a3782f6', 'request_id': 'req-2001570a-209e-4e12-8297-8966c22530f7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:12.609996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faded7bb73c24fe4abccb4b27a3782f6', 'request_id': 'req-2001570a-209e-4e12-8297-8966c22530f7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:12.616889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faded7bb73c24fe4abccb4b27a3782f6', 'request_id': 'req-2001570a-209e-4e12-8297-8966c22530f7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:12.627568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] The token cache is being invalidate because project faded7bb73c24fe4abccb4b27a3782f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:16:12.627849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:12.628469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2001570a-209e-4e12-8297-8966c22530f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:12.630059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1061/2181] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:16:12 2022] DELETE /identity/v3/projects/faded7bb73c24fe4abccb4b27a3782f6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:16:12.635741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.636025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.636307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.655117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:12.656299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:12.715002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1121/2182] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:12.722749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.723060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.723333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.743691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:12.745017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:12.755025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1062/2183] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:12.761822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:12.773323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefea69d-8a07-42f0-bb2f-d3b2b4c7e7d5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:12.778255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:12.778920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.779199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.779501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.780230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:16:12.780618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:12.782437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:12.802736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1122/2184] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:16:12.807716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:12.817656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5e0a-c1ee-4df1-aec8-23a1154ebf01 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:12.822982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:12.823763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.824332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.824332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.825194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:12.827187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:12.860527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1063/2185] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:16:12 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:16:12.862247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:12.880815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111f68-e4dd-4341-a4e6-97ea3cb241bb admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:12.963474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:12.964206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:12.964491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:12.964797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:12.965791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:12.968539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:12.998787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1123/2186] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:16:12 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:16:13.002202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.013847 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c1c62-dec0-4863-a3ed-c138b95d16d2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.018929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.019807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.020149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.020496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.021352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.023553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.036388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1064/2187] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:16:13.041246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.066914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b064a-4aa8-42e1-bb08-1f8081c0aafd admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.075483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.076276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.076879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.077172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.078130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.079885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5932cc-da61-45d3-ba75-d8f489b90fba admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.100019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1124/2188] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:16:13.104792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.115504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d557-0c75-456d-ac84-8c1625a57dd1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.121172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.122218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.122512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.122969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] PATH_INFO: `/v3/projects/59f013a0dce6469db8bddf08dc9fb15f/users/c0216407038d47368b0d18facccf2181/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.140611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f013a0dce6469db8bddf08dc9fb15f, user_id=c0216407038d47368b0d18facccf2181, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.143683 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.170154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1065/2189] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:16:13 2022] PUT /identity/v3/projects/59f013a0dce6469db8bddf08dc9fb15f/users/c0216407038d47368b0d18facccf2181/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:13.182667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.182959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.183321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.221846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] MFA Rules not processed for user `c0216407038d47368b0d18facccf2181`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:13.223123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:13.345790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1125/2190] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:13.354492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.356342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:13.445277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb076-7c42-405f-92ed-6446cfd140cd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.449860 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.450662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.451090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.451367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.461315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.462811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdad87-a8dd-4a55-96f6-84d9451547d1 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.473875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1066/2191] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:13.501186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.579629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733afd-2011-47e7-b948-8a7afcc9b687 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.584793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.586600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.586963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.587598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] PATH_INFO: `/v3/users/c0216407038d47368b0d18facccf2181` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.589473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0216407038d47368b0d18facccf2181)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.591132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.646697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0216407038d47368b0d18facccf2181'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:13.654381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0216407038d47368b0d18facccf2181'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:13.655101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0216407038d47368b0d18facccf2181'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:13.663898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0216407038d47368b0d18facccf2181'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:13.664682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0216407038d47368b0d18facccf2181'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:13.682373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1126/2192] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:16:13 2022] DELETE /identity/v3/users/c0216407038d47368b0d18facccf2181 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:16:13.686993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.687282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.687554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.706349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:13.707558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:13.772368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1067/2193] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:13.782711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:13.784700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:13.839713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904114-ff0f-4715-a595-bddfc89aa65a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:13.843269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:13.843905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:13.844182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:13.844450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:13.854004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:13.855413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1ee2c-670e-48d6-bc38-0507b43772aa service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:13.864553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1127/2194] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:14.166703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.168227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.184424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782321c-8abe-4361-ad33-533f39eca7b6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.189513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.190641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.190997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.191464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] PATH_INFO: `/v3/projects/59f013a0dce6469db8bddf08dc9fb15f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.192793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f013a0dce6469db8bddf08dc9fb15f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.195516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.244404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f013a0dce6469db8bddf08dc9fb15f', 'request_id': 'req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.249650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f013a0dce6469db8bddf08dc9fb15f', 'request_id': 'req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.256992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f013a0dce6469db8bddf08dc9fb15f', 'request_id': 'req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.268164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] The token cache is being invalidate because project 59f013a0dce6469db8bddf08dc9fb15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:16:14.268451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.269116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5447a9cf-de6b-4d28-9ec9-dd3bee9434fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.270669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1068/2195] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:16:14 2022] DELETE /identity/v3/projects/59f013a0dce6469db8bddf08dc9fb15f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:14.275889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.276400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.276706 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.295463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:14.296853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.354871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1128/2196] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:14.363497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.363780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.364053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.383099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:14.384283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.392820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1069/2197] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:14.397044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.407318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d56f4-42fd-46c9-8600-8bb1ed868476 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.411981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.412734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.413082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.414021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.414821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:16:14.415216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.416896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.430094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1129/2198] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:16:14.434625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.444443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0259345-8e21-426b-bf84-7e3a46b9b1f9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.451696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.452356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.452632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.452935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.453621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.455725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.492330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1070/2199] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:16:14.493183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.506168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2b4d-a499-4553-bf35-c261f9575554 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.552072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.553837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.567395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.568078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.568401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.568620 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.569352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.571290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.593021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1130/2200] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:16:14.596796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.612729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99309f-2c91-4e3d-8582-17b231981a05 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.618985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.620097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.620478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.621016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.621792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.623443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.628498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645e41-726c-4457-8d6a-eb869e5ca35f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.633969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.634858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.635697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.636106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] PATH_INFO: `/v3/users/c343182e346f4f45b5cba6e50e24ebe4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.637671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1131/2201] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:16:14.640959 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c343182e346f4f45b5cba6e50e24ebe4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.641359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.643087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.653993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e479f8-41b3-4c1e-a922-20b8b5463c17 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.660926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.662242 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.662639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.662997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.665147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.667632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.687141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1132/2202] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:16:14.691953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.707346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c343182e346f4f45b5cba6e50e24ebe4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.708162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d700-5e30-433e-a828-a1da328ee31a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.714684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.715788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.716374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.716977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] PATH_INFO: `/v3/projects/7c623f8bafbe4349a313eef2b75c8154/users/1f176581b3794d139a4546d6aef2b959/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.719408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c343182e346f4f45b5cba6e50e24ebe4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.729406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c343182e346f4f45b5cba6e50e24ebe4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.730172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c343182e346f4f45b5cba6e50e24ebe4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.730803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a6ff3e0-a642-43ab-9356-dd0cbc6edf50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c343182e346f4f45b5cba6e50e24ebe4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:14.740745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c623f8bafbe4349a313eef2b75c8154, user_id=1f176581b3794d139a4546d6aef2b959, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:14.744243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0621c8-351a-460f-acb6-29cc5b624350 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:14.752165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1071/2203] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:16:14 2022] DELETE /identity/v3/users/c343182e346f4f45b5cba6e50e24ebe4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:14.759317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.759937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.760408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.777684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1133/2204] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:16:14 2022] PUT /identity/v3/projects/7c623f8bafbe4349a313eef2b75c8154/users/1f176581b3794d139a4546d6aef2b959/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:16:14.785137 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:14.786156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.787021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.787148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.790000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:14.818476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:14.821130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.869136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1072/2205] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:14.881088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.883556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.908203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1134/2206] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:16:14.917132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:14.923439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:14.992399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6446e5-2647-46a0-b85d-c77a7fceef06 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.996447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441447a3-01d0-4177-ae73-e3e8a82e45f3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:14.997171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:14.997839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:14.998139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:14.998418 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.001480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:15.002209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.002558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.002896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.010795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:15.012644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:15.015357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:15.017011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df5d25-f4cd-470c-be47-9d4c51c9ddd2 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:15.027848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1135/2207] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:15.028082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1073/2208] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:16:15.194411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc9a-d7bf-40dc-9ecd-656fc1fd8acc None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.195524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc9a-d7bf-40dc-9ecd-656fc1fd8acc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.195806 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc9a-d7bf-40dc-9ecd-656fc1fd8acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.215004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3198cc9a-d7bf-40dc-9ecd-656fc1fd8acc None None] MFA Rules not processed for user `775d3d61ab8d42c3a528028592ad71f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:15.216199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3198cc9a-d7bf-40dc-9ecd-656fc1fd8acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:15.284925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1136/2209] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:15.622798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:15.624290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:15.642223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e966-56b6-4221-801c-a503fffd3df2 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:15.647703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:15.649665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.650109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.650540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] PATH_INFO: `/v3/projects/60f8589ccc154b698c08c9ae6000b92e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.652027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f8589ccc154b698c08c9ae6000b92e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:15.654504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:15.726887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f8589ccc154b698c08c9ae6000b92e', 'request_id': 'req-28086497-75f6-450b-8e5f-0e758a0b7b3d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:15.734109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f8589ccc154b698c08c9ae6000b92e', 'request_id': 'req-28086497-75f6-450b-8e5f-0e758a0b7b3d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:15.744426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f8589ccc154b698c08c9ae6000b92e', 'request_id': 'req-28086497-75f6-450b-8e5f-0e758a0b7b3d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:15.758094 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] The token cache is being invalidate because project 60f8589ccc154b698c08c9ae6000b92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:16:15.758490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:15.759222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28086497-75f6-450b-8e5f-0e758a0b7b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:15.761755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1074/2210] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:16:15 2022] DELETE /identity/v3/projects/60f8589ccc154b698c08c9ae6000b92e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:16:15.766743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.767035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.767338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.786910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:15.788108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:15.859060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1137/2211] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:15.866315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.867161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.867437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.889609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:15.890869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:15.909661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1075/2212] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:15.915100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:15.925398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ee538-505c-4ab0-94b1-a4931e23bdab None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:15.931230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:15.932202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.932491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.933125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.933735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:16:15.934046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:15.935903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:15.953071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1138/2213] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:16:15.956844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:15.968539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68732e5-b66b-4376-be62-ed72702430a4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:15.973502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:15.974157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:15.974540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:15.974711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:15.975385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:15.978145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd48c6-3e7e-4fd8-91ee-0bc5fb0afa9a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.009992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1076/2214] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:16:15 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:16:16.025585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.049360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00cda-1bce-4693-8a31-038d081ebd4b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.053181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.053637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.054116 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.098802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] MFA Rules not processed for user `1f176581b3794d139a4546d6aef2b959`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:16.103927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:16.215470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.220866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.221173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.221424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.222128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.224059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.250931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1077/2215] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:16:16.263922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.265954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:16.267729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1139/2216] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:16:16 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:16:16.271264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.282708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892a91-204f-435f-a4a0-7f3731c6d609 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.287608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.289306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.289599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.289875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.290605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.292192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.316972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1140/2217] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:16:16.317899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.328538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f4be-9c30-47cf-80d6-69a36cae00b4 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.338769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefbb39-559d-48ab-bfb7-e92ebea374f3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.339695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.340549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.341037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.341458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.342355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.343357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.344031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.344290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.344563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.348056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.354720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.356186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae7cc2-46a6-4d24-90d4-0d534af59449 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.371747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1141/2218] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:16:16.372504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.376641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1078/2219] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:16:16.385269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55318edc-183d-4a44-a0d8-8de6329650ef admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.390577 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.392127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.392127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.392127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] PATH_INFO: `/v3/projects/9afeedda420a4a8d99569bb8308c45e4/users/84d60ae3d0964163848d82044e0f491a/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.409869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afeedda420a4a8d99569bb8308c45e4, user_id=84d60ae3d0964163848d82044e0f491a, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.413543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.435084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1142/2220] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:16:16 2022] PUT /identity/v3/projects/9afeedda420a4a8d99569bb8308c45e4/users/84d60ae3d0964163848d82044e0f491a/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:16.446419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac0ba-a738-472a-8153-a2476f9a5f5b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.447125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac0ba-a738-472a-8153-a2476f9a5f5b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.447493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac0ba-a738-472a-8153-a2476f9a5f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.483228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-79dac0ba-a738-472a-8153-a2476f9a5f5b None None] MFA Rules not processed for user `84d60ae3d0964163848d82044e0f491a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:16.484448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-79dac0ba-a738-472a-8153-a2476f9a5f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:16.579251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1079/2221] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:16.676590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:16.762796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d9fdf-6306-4d3f-97b4-4debeeb54344 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:16.766933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:16.767641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:16.768034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:16.768328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:16.779215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:16.780660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f2d2-b0e8-493e-b675-cc5a20e8e689 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:16.806174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1143/2222] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:17.902145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1442-9935-4be5-8ae3-c1ddbc05df4e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:17.902961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1442-9935-4be5-8ae3-c1ddbc05df4e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:17.903383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1442-9935-4be5-8ae3-c1ddbc05df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:17.922546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1dac1442-9935-4be5-8ae3-c1ddbc05df4e None None] MFA Rules not processed for user `1f176581b3794d139a4546d6aef2b959`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:17.923822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1dac1442-9935-4be5-8ae3-c1ddbc05df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:18.000698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1080/2223] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:20.016712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:20.017287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:20.017287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:20.036821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] MFA Rules not processed for user `6dac5d7569d4402ca9c910ea8862b5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:20.037496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:20.101396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1144/2224] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:23.158044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:23.159161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:23.159637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:23.193102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:23.194421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:23.271510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1081/2225] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:23.315084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:23.316584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:23.419569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82c81-96ac-46d2-aa36-1a6954e1f45a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:23.424615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:23.425288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:23.425566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:23.425839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:23.434791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:23.436363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9432-fd6c-4ce1-b7a7-b8f12c3d0ac8 service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:23.445202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1145/2226] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:16:25.150402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:25.302432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51567d43-2318-432f-b8bc-df408ec758ae None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:25.313318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:25.314548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:25.315039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:25.315587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] PATH_INFO: `/v3/users/84d60ae3d0964163848d82044e0f491a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:25.319790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d60ae3d0964163848d82044e0f491a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:25.323467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:25.454376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d60ae3d0964163848d82044e0f491a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:25.492142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d60ae3d0964163848d82044e0f491a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:25.519452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d60ae3d0964163848d82044e0f491a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:25.520297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d60ae3d0964163848d82044e0f491a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:25.521015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d60ae3d0964163848d82044e0f491a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:25.576884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1082/2227] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:16:25 2022] DELETE /identity/v3/users/84d60ae3d0964163848d82044e0f491a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:25.581192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:25.582097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:25.582538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:25.625328 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:25.627125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:25.701525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1146/2228] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:25.711712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:25.713621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:25.842793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a1643-7ec9-4236-bc80-426e928a60a5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:25.851869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:25.853012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:25.853621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:25.854840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:25.873902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:25.876197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d413e-2850-4f66-974d-de03ad9b2a22 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:25.910038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1083/2229] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:26.472744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:26.476448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:26.496993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267973e-888c-4bb4-b3d7-785c9a7526d1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:26.510669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:26.511855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:26.514130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:26.516031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] PATH_INFO: `/v3/projects/9afeedda420a4a8d99569bb8308c45e4` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:26.520573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afeedda420a4a8d99569bb8308c45e4)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:26.524211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:26.714213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afeedda420a4a8d99569bb8308c45e4', 'request_id': 'req-e81f192c-78f0-4117-b3be-c1d654fef4eb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:26.732001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afeedda420a4a8d99569bb8308c45e4', 'request_id': 'req-e81f192c-78f0-4117-b3be-c1d654fef4eb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:26.758615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afeedda420a4a8d99569bb8308c45e4', 'request_id': 'req-e81f192c-78f0-4117-b3be-c1d654fef4eb'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:26.790765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] The token cache is being invalidate because project 9afeedda420a4a8d99569bb8308c45e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:16:26.791067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:26.798335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e81f192c-78f0-4117-b3be-c1d654fef4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:16:26.803516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1147/2230] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:16:26 2022] DELETE /identity/v3/projects/9afeedda420a4a8d99569bb8308c45e4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:41.205595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.206112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.206222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.207519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1084/2231] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:41.214155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e9b3-598d-4300-9b2a-4032a5bfaf8b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.218615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e9b3-598d-4300-9b2a-4032a5bfaf8b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.219046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e9b3-598d-4300-9b2a-4032a5bfaf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.259543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1c83e9b3-598d-4300-9b2a-4032a5bfaf8b None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:41.261833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1c83e9b3-598d-4300-9b2a-4032a5bfaf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:41.359999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1148/2232] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:16:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:41.372132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:41.374083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:41.433300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a947f2-3b38-4df9-b9d5-d404efdc2295 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:41.436948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:41.442124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.442124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.442124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.450712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:41.452153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b580d-775a-48f6-b2d5-d4159b168c79 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:41.463436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1085/2233] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:41.530939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.531156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.531636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.533044 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1149/2234] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:41.538641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4e68-890b-4b26-ad96-b10f2c4e50f2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.538958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4e68-890b-4b26-ad96-b10f2c4e50f2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.539922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4e68-890b-4b26-ad96-b10f2c4e50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.557630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-25bf4e68-890b-4b26-ad96-b10f2c4e50f2 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:41.558869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-25bf4e68-890b-4b26-ad96-b10f2c4e50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:41.610840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1086/2235] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:16:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:41.623333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:41.625526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:41.638359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6b01-aed4-463f-99b4-051ae141b68f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:41.643089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:41.645333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.645616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.645889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.653923 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:41.655343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027ccc-06ec-4154-94fb-180d9024f038 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:41.663412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1150/2236] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:41.752039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb872-93d5-4892-b5d2-3aa7738b786c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.752425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb872-93d5-4892-b5d2-3aa7738b786c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.752736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb872-93d5-4892-b5d2-3aa7738b786c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.754747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1087/2237] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:41.761633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71ca7-528a-49a7-8f13-bb1940e4d9b4 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.761924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71ca7-528a-49a7-8f13-bb1940e4d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.762197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71ca7-528a-49a7-8f13-bb1940e4d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.781625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dbf71ca7-528a-49a7-8f13-bb1940e4d9b4 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:41.782731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dbf71ca7-528a-49a7-8f13-bb1940e4d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:41.792609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1151/2238] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:16:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:41.803102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdb872-93d5-4892-b5d2-3aa7738b786c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:41.815334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdb872-93d5-4892-b5d2-3aa7738b786c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:41.819041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:41.819757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:41.820038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:41.820950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:41.831821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:41.833363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:41.844962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1088/2239] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:16:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:44.697387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:44.697387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:44.697855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:44.719249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:44.720487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:44.825757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1152/2240] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:44.839781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:44.841363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:44.967538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8499a4-2b6c-4a70-a516-a59cd294e9e4 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:44.972820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:44.973479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:44.973757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:44.974175 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:44.991887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:44.993965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6121298-0bb0-42a8-9ec7-549697e4a399 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:45.002883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1089/2241] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:17:11.805318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:11.807437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:11.899468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0afca-652e-40b5-9fec-084c2ddd7b62 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:11.904873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:11.905518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:11.905797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:11.906069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:11.908104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:11.919917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:11.921524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:11.931183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1153/2242] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:17:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:17.094130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd12-b940-4a71-89d6-9cf91a3a226a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:17.094649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd12-b940-4a71-89d6-9cf91a3a226a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:17.095091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd12-b940-4a71-89d6-9cf91a3a226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:17.147458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5e50dd12-b940-4a71-89d6-9cf91a3a226a None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:17.149265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5e50dd12-b940-4a71-89d6-9cf91a3a226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:17.174378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1090/2243] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:17:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:17.188804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:17.214074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668886-d5f9-46bd-b7ab-7a34bbe2dad3 service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:17.219605 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:17.220256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:17.220531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:17.220847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:17.233062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:17.234768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639294f-da57-4a17-87d2-be04a107cbfb service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:17.245686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1154/2244] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:17:32.955948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a5a7-9c8f-4fa0-9678-98613d830e78 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:32.956450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a5a7-9c8f-4fa0-9678-98613d830e78 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:32.956556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a5a7-9c8f-4fa0-9678-98613d830e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:32.973844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf49a5a7-9c8f-4fa0-9678-98613d830e78 None None] MFA Rules not processed for user `1f176581b3794d139a4546d6aef2b959`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:32.975021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf49a5a7-9c8f-4fa0-9678-98613d830e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:33.027103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1091/2245] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:17:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:13.857823 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963722-65c1-48a1-a552-ff9a944d4274 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:13.859542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963722-65c1-48a1-a552-ff9a944d4274 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:13.860238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963722-65c1-48a1-a552-ff9a944d4274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:13.896830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-11963722-65c1-48a1-a552-ff9a944d4274 None None] MFA Rules not processed for user `775d3d61ab8d42c3a528028592ad71f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:13.898100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11963722-65c1-48a1-a552-ff9a944d4274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:13.983624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1155/2246] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:17.417327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:17.417841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:17.417841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:17.435983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] MFA Rules not processed for user `a8a3337faba84d0aa85df4121ffb5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:17.437187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:17.496633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1092/2247] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:22.543118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:22.543644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:22.543734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:22.562532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] MFA Rules not processed for user `6dac5d7569d4402ca9c910ea8862b5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:22.563744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:22.621235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1156/2248] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:36.809492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:36.811044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:36.874760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43088de2-161f-458a-a66c-d50cdb954318 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:36.879278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:36.880145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:36.880425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:36.880730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] PATH_INFO: `/v3/users/1f176581b3794d139a4546d6aef2b959` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:36.881907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f176581b3794d139a4546d6aef2b959)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:36.883924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:36.927958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f176581b3794d139a4546d6aef2b959'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:36.936490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f176581b3794d139a4546d6aef2b959'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:36.943328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f176581b3794d139a4546d6aef2b959'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:36.944053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f176581b3794d139a4546d6aef2b959'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:36.944738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1919aa2f-653c-4bce-9b41-5b59a264967c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f176581b3794d139a4546d6aef2b959'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:36.961859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1093/2249] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:18:36 2022] DELETE /identity/v3/users/1f176581b3794d139a4546d6aef2b959 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:37.139996 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.152816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b969-70b6-4feb-9cbf-e2220e579bf8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.238380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.239198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.239665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.239942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] PATH_INFO: `/v3/projects/7c623f8bafbe4349a313eef2b75c8154` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.241187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c623f8bafbe4349a313eef2b75c8154)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.244210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.311704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c623f8bafbe4349a313eef2b75c8154', 'request_id': 'req-b09353b5-5e29-4b1d-adb3-44c2d4e21081'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:37.317862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c623f8bafbe4349a313eef2b75c8154', 'request_id': 'req-b09353b5-5e29-4b1d-adb3-44c2d4e21081'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:37.326798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c623f8bafbe4349a313eef2b75c8154', 'request_id': 'req-b09353b5-5e29-4b1d-adb3-44c2d4e21081'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:37.341094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] The token cache is being invalidate because project 7c623f8bafbe4349a313eef2b75c8154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:18:37.341499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:37.342815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b09353b5-5e29-4b1d-adb3-44c2d4e21081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:37.346140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1157/2250] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:18:37 2022] DELETE /identity/v3/projects/7c623f8bafbe4349a313eef2b75c8154 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:37.351365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.352416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.352737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.392562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:37.393853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:37.465570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1094/2251] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:37.467791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.468141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.468481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.488828 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:37.489966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:37.499423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1158/2252] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:37.503873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.514052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae74a-6430-4690-9807-16501eca01bf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.518594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.519241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.519520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.519791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.520516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:37.520852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.522445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.534402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1095/2253] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:18:37.538627 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.548406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55094ab-5eea-4a3d-a2f2-e957c6b60719 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.553050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.553700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.553980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.554251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.555593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.557522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.588178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1159/2254] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:18:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:18:37.589679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.599994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5132-f89c-46a1-a0da-ae8a923b3f04 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.657236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.657960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.658242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.658516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.659281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.661205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.682699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1096/2255] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:18:37 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:37.686856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.697084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf6d72-9c1c-499b-97f5-0c3de4114a47 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.701937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.702613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.702904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.703181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.704555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.706227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.716884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1160/2256] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:37.721277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.731843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6156-5174-42cb-a73d-e37b6bae2587 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.736457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.737142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.737417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.737685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.738400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.740036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230f890-b8d0-44c1-886b-e2b546351207 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.750513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1097/2257] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:37.754726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.764790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335af3-39c5-4e8f-8fe9-b2f8d0e0c5c4 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.769410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.770358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.770699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.771035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] PATH_INFO: `/v3/projects/b79f1de979384c108b5ff0427e44e30b/users/a18ecdf65b7c42e0aeb44519eaaff743/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.785452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79f1de979384c108b5ff0427e44e30b, user_id=a18ecdf65b7c42e0aeb44519eaaff743, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.788155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.802415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1161/2258] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:18:37 2022] PUT /identity/v3/projects/b79f1de979384c108b5ff0427e44e30b/users/a18ecdf65b7c42e0aeb44519eaaff743/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:37.807944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98037-07ed-434b-bac4-31e67bab5b30 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.808227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98037-07ed-434b-bac4-31e67bab5b30 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.808501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98037-07ed-434b-bac4-31e67bab5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.825713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4bf98037-07ed-434b-bac4-31e67bab5b30 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:37.826918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4bf98037-07ed-434b-bac4-31e67bab5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:37.884864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1098/2259] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:37.894182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:37.895945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:37.953445 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787c90b-2339-4756-82ae-7bba475ee18b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:37.957554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:37.958379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:37.958489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:37.958742 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:37.969216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:37.970642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:37.981116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1162/2260] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:42.397537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.397987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.398114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.439020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] MFA Rules not processed for user `a18ecdf65b7c42e0aeb44519eaaff743`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:42.440499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:42.514134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1099/2261] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:42.518597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.528509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed84872-f197-4487-976b-cda6b1f9d479 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.533395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.534053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.534334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.534634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.535356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.537291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.568278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1163/2262] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:42.569390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.581833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf7e7-c084-4d8d-9d81-1fa82ef31a9b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.640834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.641513 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.641791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.642064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.642770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.644817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.666986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1100/2263] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:18:42 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:18:42.671048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.682500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ad57-601d-4385-86ba-0c41afec859a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.687231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.688037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.688544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.688920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.689729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.691400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.703318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1164/2264] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:42.707629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.719204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e81bb-0f37-4f0f-8e85-d84e6402a38c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.724199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.725324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.725608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.725886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] PATH_INFO: `/v3/projects/513434fe6f004d5593457f20b2272567/users/e97379f441174f23a9fb2e9e747d9fa8/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.742660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513434fe6f004d5593457f20b2272567, user_id=e97379f441174f23a9fb2e9e747d9fa8, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.745990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.760370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1101/2265] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:18:42 2022] PUT /identity/v3/projects/513434fe6f004d5593457f20b2272567/users/e97379f441174f23a9fb2e9e747d9fa8/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:42.764397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.775745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc4c0-b811-4e19-8b49-e9258e80aa9d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.835103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.835879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.836800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.837083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.843042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.843042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98cb98-f45e-40af-aba7-59464441e5f9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.856056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1165/2266] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:42.856737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:42.869810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f568-de68-439c-ad86-88107a033f33 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:42.874653 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:42.875535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:42.875815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:42.876088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] PATH_INFO: `/v3/projects/513434fe6f004d5593457f20b2272567/users/e97379f441174f23a9fb2e9e747d9fa8/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:42.878135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513434fe6f004d5593457f20b2272567, user_id=e97379f441174f23a9fb2e9e747d9fa8, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:42.880795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:42.891607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1102/2267] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:18:42 2022] PUT /identity/v3/projects/513434fe6f004d5593457f20b2272567/users/e97379f441174f23a9fb2e9e747d9fa8/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:47.265680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306103f-d35c-45b6-9ac3-9f700bf544a9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:47.266192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306103f-d35c-45b6-9ac3-9f700bf544a9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:47.266290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306103f-d35c-45b6-9ac3-9f700bf544a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:47.294269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0306103f-d35c-45b6-9ac3-9f700bf544a9 None None] MFA Rules not processed for user `e97379f441174f23a9fb2e9e747d9fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:47.295652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0306103f-d35c-45b6-9ac3-9f700bf544a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:47.370517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1166/2268] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:47.378095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:47.379816 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:47.464470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8b59-e27c-4c09-848c-a6fd1ae82632 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:47.468443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:47.469157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:47.469441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:47.469743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:47.530207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:47.532099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:47.542552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1103/2269] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:18:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:47.657232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a0b-f89c-45c2-9ed1-dc3d9c55e486 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:47.657598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a0b-f89c-45c2-9ed1-dc3d9c55e486 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:47.657945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a0b-f89c-45c2-9ed1-dc3d9c55e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:47.676015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-1dfb4a0b-f89c-45c2-9ed1-dc3d9c55e486 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:47.677341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-1dfb4a0b-f89c-45c2-9ed1-dc3d9c55e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:47.738513 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1167/2270] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:47.787435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:47.789681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:47.874984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e6ad-3fe6-4cfe-a397-943a2e600ce3 service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:47.893815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:47.894475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:47.895277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:47.895277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:47.912775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:47.915064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79363153-ac7b-4960-8747-0c78be8e9013 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:47.923219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1104/2271] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:18:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:18:56.608732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.609268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.609376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.627114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] MFA Rules not processed for user `a18ecdf65b7c42e0aeb44519eaaff743`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:56.628290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:56.635426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1168/2272] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:18:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:58.431169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.431666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.431768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.449617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:58.450825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:58.457918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1105/2273] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:18:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:58.471276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:58.484560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cbc92-a992-42c6-876f-2b5db589b2e8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:58.489858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:58.490573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.490917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.491269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.500249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:58.502066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:58.510778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1169/2274] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:18:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:19:06.563384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.635222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09c882-c239-4318-9c0f-5d329382f088 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.638906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.639585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.639861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.640130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.641911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:06.734364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.735856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58159-de9d-4243-904c-dbacae48b216 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.756541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1106/2275] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:10.281861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:10.283352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:10.295769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053b2b-6491-4a5d-9b12-918934ef792f service swift] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:10.299481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:10.300137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:10.300412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:10.300739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.302465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:10.315633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:10.317066 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:10.327616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1170/2276] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:19.361083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.361694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.361949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.382009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] MFA Rules not processed for user `314a5e1a357c4a73a33391b6f25a44c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:19.384459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:19.444230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1107/2277] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:20.151219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:20.153594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.243285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b302c4e-1c54-4e39-b21f-a67da1bc72f5 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:20.250036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:20.251161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.253065 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.254915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.258592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.271264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:20.274374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:20.286174 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1171/2278] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:22.111851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:22.132866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962d171-ff49-424c-b47e-6fb8fec3f53b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:22.137505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:22.138133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.138477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.138677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.142118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:22.156269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:22.158763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:22.172109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1108/2279] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:24.662286 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:24.664023 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:24.678370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eda03-d464-46d2-8d87-617aca6e6ffa service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:24.683975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:24.684610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:24.684946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:24.685199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:24.687347 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:24.744956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:24.746529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:24.755316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1172/2280] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:25.643197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:25.644567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.722312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f65d-dadb-434e-b9c3-6a219d4ca53e service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:25.726587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:25.727266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:25.727541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:25.727806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:25.729619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.786721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:25.788811 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:25.797782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1109/2281] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:27.631739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:27.641567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8207e-687d-49a7-8a1f-1c3e295321ec service nova] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:27.645094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:27.645735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:27.646013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:27.646284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:27.648449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:27.660544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:27.661989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:27.671103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1173/2282] 10.222.0.55 () {60 vars in 1396 bytes} [Tue May 10 03:19:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:31.676252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:31.689713 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5605-92e7-44c5-a8a4-b53a845764de service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:31.695149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:31.696571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:31.696969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:31.697393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:31.699182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:31.754228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:31.755735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:31.765283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1110/2283] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:35.192306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:35.201865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ca54-55da-4a5f-a1f7-65c59176ea99 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:35.206341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:35.207003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:35.207292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:35.207569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:35.209432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:35.277951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:35.279657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:35.291154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1174/2284] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:36.375788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:36.377250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:36.392398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60245-3d23-4126-80ee-805a5f80482d service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:36.400488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:36.401697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.401697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.401697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.403796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:36.417140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:36.418843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:36.431040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1111/2285] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:36.450002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:36.459469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726f15-e3ce-4b03-aa4a-8c7fd2438fc2 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:36.464763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:36.465779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.466217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.466698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.478045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:36.479743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:36.493795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1175/2286] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:41.871288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.873835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:41.895195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd3c9-9f10-41e5-ba6a-b34721aeb6d7 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.902486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.903361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.903743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.904007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] PATH_INFO: `/v3/users/6dac5d7569d4402ca9c910ea8862b5d9` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.905495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dac5d7569d4402ca9c910ea8862b5d9)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.907423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.954871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dac5d7569d4402ca9c910ea8862b5d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.963933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dac5d7569d4402ca9c910ea8862b5d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.971198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dac5d7569d4402ca9c910ea8862b5d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.971854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dac5d7569d4402ca9c910ea8862b5d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.972468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58c0230e-517f-467d-812f-bf3567d856f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dac5d7569d4402ca9c910ea8862b5d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.991619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1112/2287] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:19:41 2022] DELETE /identity/v3/users/6dac5d7569d4402ca9c910ea8862b5d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:42.244003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.258359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb14-2a0d-4232-8d38-ecf8dc885666 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.400055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.401073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.401448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.402359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] PATH_INFO: `/v3/projects/d2279255bed8483c82ba27a2451313fc` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.403862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2279255bed8483c82ba27a2451313fc)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.406957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:42.489866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2279255bed8483c82ba27a2451313fc', 'request_id': 'req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:42.501421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2279255bed8483c82ba27a2451313fc', 'request_id': 'req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:42.511536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2279255bed8483c82ba27a2451313fc', 'request_id': 'req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:42.523274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] The token cache is being invalidate because project d2279255bed8483c82ba27a2451313fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:42.523783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:42.524509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a1629a00-261e-4eb4-8c88-9a43f4e0f9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:42.526743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1176/2288] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:19:42 2022] DELETE /identity/v3/projects/d2279255bed8483c82ba27a2451313fc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:42.539494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.539922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.540307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.559624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:42.560913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:42.660231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1113/2289] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:42.668664 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.669210 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.669539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.698990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:42.700805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:42.724378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.725137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1177/2290] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:42.735062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f24ec-e779-41d5-a0eb-d3d17f811fc8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.747746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.748556 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.748984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.749353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.750207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:42.750604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.761153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:42.777928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1114/2291] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:42.782339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.794222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d537d-f89b-4122-90e8-277665c58f3b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.800617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.801610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.802238 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.802524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.803260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.806766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:42.841981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1178/2292] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:19:42 2022] POST /identity/v3/projects => generated 355 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:42.845957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.858920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924bc0-affb-406b-90de-6502128c1b5a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.934253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.935590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.936106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.936602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.937436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.940862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:42.969659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1115/2293] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:19:42 2022] POST /identity/v3/users => generated 278 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:42.974176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.986807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2fb9-6962-4546-a6fa-43dff64a7b9d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.993316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.994127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.994505 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.995474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.995836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.997788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.015996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.025197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1179/2294] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:43.033438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd071-ccf0-4f08-a2a2-2ce4a3e59361 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.041268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.042386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.042853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.043599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.044910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.046781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768153f5-7c4f-43d5-81f9-6c83ebf981f6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.059194 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1116/2295] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:43.064100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.074503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad560fb-d4df-4781-a956-598e19f924f4 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.088998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.090592 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.091671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.091671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] PATH_INFO: `/v3/projects/de83d555dd1c4b2690ea63ccf7cc2d73/users/e8f8991870974f47b444d409e3f5f275/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.117046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de83d555dd1c4b2690ea63ccf7cc2d73, user_id=e8f8991870974f47b444d409e3f5f275, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.120425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.141953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1180/2296] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:19:43 2022] PUT /identity/v3/projects/de83d555dd1c4b2690ea63ccf7cc2d73/users/e8f8991870974f47b444d409e3f5f275/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:43.153403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.153991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.154509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.192410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] MFA Rules not processed for user `e8f8991870974f47b444d409e3f5f275`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:43.193674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.265711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1117/2297] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:43.270003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.345292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877b5b-e3e5-4c4f-9c84-019405dc848f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.350266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.351252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.351864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.352231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.353215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.355261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.386628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1181/2298] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:43.391523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.410869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836a61d-301e-4698-ba35-7546cde71003 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.471598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.473386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.474017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.474297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.474997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.477558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.501339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1118/2299] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:43.505410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.517178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cd70b-8fa0-4875-bc28-b5f62974a609 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.522205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.523417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.523894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.524262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.525031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.526668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.540190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1182/2300] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:43.544697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.556606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57851f6f-a17c-43c1-a438-7d5fdd6c59b6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.561414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.562302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.562579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.562848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] PATH_INFO: `/v3/projects/c1f27be6159e4fa1bb29875b43c84879/users/b806a66caef34153af752047db012f31/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.578927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f27be6159e4fa1bb29875b43c84879, user_id=b806a66caef34153af752047db012f31, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.581647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.596813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1119/2301] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:19:43 2022] PUT /identity/v3/projects/c1f27be6159e4fa1bb29875b43c84879/users/b806a66caef34153af752047db012f31/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:43.600668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.612022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161389-112b-4f8e-b68f-4edb9839e640 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.668748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.669493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.669757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.670031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.670754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.672345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2a582-ada9-47a0-8af1-5a7eb35a132e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.683302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1183/2302] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:43.687450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.698940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68dd1a-ea9a-4f17-a6dc-a1cf9dae96e0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.703616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.704492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.704884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.705161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] PATH_INFO: `/v3/projects/c1f27be6159e4fa1bb29875b43c84879/users/b806a66caef34153af752047db012f31/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.707259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f27be6159e4fa1bb29875b43c84879, user_id=b806a66caef34153af752047db012f31, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.710800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.721014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1120/2303] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:19:43 2022] PUT /identity/v3/projects/c1f27be6159e4fa1bb29875b43c84879/users/b806a66caef34153af752047db012f31/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:43.732142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.732430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.732745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.760643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] MFA Rules not processed for user `b806a66caef34153af752047db012f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:43.761898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.830700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1184/2304] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:43.842577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.844537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.906966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c472-615f-4e26-a7f6-29cd33682600 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.911233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.911920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.912222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.915340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.924193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.925665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6c21-dcb6-42bd-b80c-884c924a4345 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.936936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1121/2305] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:44.013576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:44.024532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639996-f51e-4983-82de-16237ee6b1dc None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:44.028064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:44.028763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.029050 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.029324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.091413 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:44.092936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:44.102434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1185/2306] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:44.445730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278aab7-a593-4cd5-a98e-e616ff88e079 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.446014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278aab7-a593-4cd5-a98e-e616ff88e079 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.446285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278aab7-a593-4cd5-a98e-e616ff88e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.463892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7278aab7-a593-4cd5-a98e-e616ff88e079 None None] MFA Rules not processed for user `775d3d61ab8d42c3a528028592ad71f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:44.465098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7278aab7-a593-4cd5-a98e-e616ff88e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.518771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1122/2307] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:19:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:44.833096 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:44.834667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.896189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329de0-6bb2-4872-9afd-f931cab422b4 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:44.900488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:44.901167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.901464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.901720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.903490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.913878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:44.915557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:44.917134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.917447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.917721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.924825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1186/2308] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:44.936259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:44.937498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.995220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1123/2309] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:19:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:45.008536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:45.010054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:45.090916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80238069-07f3-4b78-a6b1-23d12deafa89 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:45.095938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:45.096619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:45.096926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:45.097201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:45.106270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:45.108061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:45.116845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1187/2310] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:19:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:19:48.314780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.316517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.446093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cca67-6c11-4217-b4e5-bdfc332f1162 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.452646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.454305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.454787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.455222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.458290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.473538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.477691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.503363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1124/2311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:57.968746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.984299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f214-d55f-4dcc-a533-5e9807d14db0 service swift] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.990006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.990654 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.990985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.991441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.993376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.005953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.007924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413795d8-b93f-4a98-9e62-8a3d317950ea service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.018531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1188/2312] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:19:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:00.299891 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:00.367910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190e46-4fcb-40f0-88bd-d5185fc20ac6 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:00.372473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:00.373253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:00.373628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:00.373793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] PATH_INFO: `/v3/users/e8f8991870974f47b444d409e3f5f275` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:00.374977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f8991870974f47b444d409e3f5f275)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:00.376917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:00.424087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f8991870974f47b444d409e3f5f275'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.431575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f8991870974f47b444d409e3f5f275'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.438523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f8991870974f47b444d409e3f5f275'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.439170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f8991870974f47b444d409e3f5f275'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.439776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f8991870974f47b444d409e3f5f275'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.457320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1125/2313] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:00 2022] DELETE /identity/v3/users/e8f8991870974f47b444d409e3f5f275 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:00.462509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:00.463011 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:00.463104 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:00.482846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:00.484154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:00.545268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1189/2314] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:00.555789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:00.557319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:00.615516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7aef6-1c40-4726-8baa-376d86979774 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:00.619987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:00.620878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:00.621343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:00.621680 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:00.630979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:00.633168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:00.642693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1126/2315] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:00.917018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:00.919300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:00.935111 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ed50-7dbe-46c2-bf9a-b79428a05fe2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:00.940015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:00.940905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:00.941182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:00.941451 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] PATH_INFO: `/v3/projects/de83d555dd1c4b2690ea63ccf7cc2d73` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:00.942796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de83d555dd1c4b2690ea63ccf7cc2d73)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:00.945574 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:00.992603 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de83d555dd1c4b2690ea63ccf7cc2d73', 'request_id': 'req-7ca8fc82-f1db-46cd-8d57-99e153c2a352'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.998375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de83d555dd1c4b2690ea63ccf7cc2d73', 'request_id': 'req-7ca8fc82-f1db-46cd-8d57-99e153c2a352'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.005844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de83d555dd1c4b2690ea63ccf7cc2d73', 'request_id': 'req-7ca8fc82-f1db-46cd-8d57-99e153c2a352'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.019022 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] The token cache is being invalidate because project de83d555dd1c4b2690ea63ccf7cc2d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:01.019317 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.019978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-7ca8fc82-f1db-46cd-8d57-99e153c2a352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.021690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1190/2316] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:00 2022] DELETE /identity/v3/projects/de83d555dd1c4b2690ea63ccf7cc2d73 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:01.026152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.035830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb57ce2-cf0c-4601-bd0b-7fbdafa6272c service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.093896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.094764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.095039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.095329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] PATH_INFO: `/v3/users/b806a66caef34153af752047db012f31` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.096504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b806a66caef34153af752047db012f31)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.098478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.145155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b806a66caef34153af752047db012f31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.152784 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b806a66caef34153af752047db012f31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.160443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b806a66caef34153af752047db012f31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.161118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b806a66caef34153af752047db012f31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.161706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b1a5b02-0b12-4811-a6da-dffe662dae02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b806a66caef34153af752047db012f31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.183801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1127/2317] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:01 2022] DELETE /identity/v3/users/b806a66caef34153af752047db012f31 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:01.221366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.221791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.222325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.224251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1191/2318] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:20:01.231859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9067-5f95-49de-b184-2d4962294572 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.232192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9067-5f95-49de-b184-2d4962294572 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.232497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9067-5f95-49de-b184-2d4962294572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.273965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-784f9067-5f95-49de-b184-2d4962294572 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.275471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-784f9067-5f95-49de-b184-2d4962294572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.353535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1128/2319] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:01.366514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.368924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.426410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58013b-4c8f-485e-b1e1-59eaf8edf8e6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.430761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.431407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.431686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.431958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.441939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.443357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a749e3-615a-438f-bbe5-7787a1cda926 service glance] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.454054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1192/2320] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:01.473595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9067-5f95-49de-b184-2d4962294572 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.475861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-784f9067-5f95-49de-b184-2d4962294572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.525270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccf9d-b1c8-444d-89f4-fffd1f88eafc None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.525818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccf9d-b1c8-444d-89f4-fffd1f88eafc None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.525818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccf9d-b1c8-444d-89f4-fffd1f88eafc None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.527166 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1193/2321] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:20:01.532189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.532475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.532786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.552466 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] MFA Rules not processed for user `b14194021b484ce884af2c593d59e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.554306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.559868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9067-5f95-49de-b184-2d4962294572 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.564320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.565196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.565474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.565741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] PATH_INFO: `/v3/projects/c1f27be6159e4fa1bb29875b43c84879` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.566935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f27be6159e4fa1bb29875b43c84879)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.568875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.606637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1194/2322] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:01.614323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f27be6159e4fa1bb29875b43c84879', 'request_id': 'req-936cb904-3b49-46ff-a8a8-8131825ccdfd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.618947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.620313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f27be6159e4fa1bb29875b43c84879', 'request_id': 'req-936cb904-3b49-46ff-a8a8-8131825ccdfd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.620449 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.628400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f27be6159e4fa1bb29875b43c84879', 'request_id': 'req-936cb904-3b49-46ff-a8a8-8131825ccdfd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.631361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a06b7-5535-44f6-812f-53dc90a6ff31 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.640565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] The token cache is being invalidate because project c1f27be6159e4fa1bb29875b43c84879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:01.640881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.641512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-936cb904-3b49-46ff-a8a8-8131825ccdfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.643059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1129/2323] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:01 2022] DELETE /identity/v3/projects/c1f27be6159e4fa1bb29875b43c84879 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:01.647772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.647992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.648265 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.666145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.667330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.681237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.681891 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.682171 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.682446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.684699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.694529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.696408 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e02d2-81f3-486c-8a84-0e3ab0635c28 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.704183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1195/2324] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:01.732741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1130/2325] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:01.740390 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e6e9-475e-48db-8eca-383f482438c0 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.741240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e6e9-475e-48db-8eca-383f482438c0 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.741689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e6e9-475e-48db-8eca-383f482438c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.760409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9c76e6e9-475e-48db-8eca-383f482438c0 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.761640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9c76e6e9-475e-48db-8eca-383f482438c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.769459 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1196/2326] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:01.774360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.784100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c6c56-02ba-4b8c-b8ce-75add1ecda7f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.789303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17736d-ed67-4e8e-94df-c67be9cae4d2 None None] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.789590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17736d-ed67-4e8e-94df-c67be9cae4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.789697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.789864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17736d-ed67-4e8e-94df-c67be9cae4d2 None None] PATH_INFO: `/` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.790355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.790655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.790927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.791209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1197/2327] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 10 03:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:20:01.791659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:01.791961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.793600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.795981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.796267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.796540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.809223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1131/2328] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:01.810162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.815150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] MFA Rules not processed for user `a3fa3765319b4024ab300ae52161d649`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.816360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.820224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f742c-ce20-4988-bae0-0bb7668eaab4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.824850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.825547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.825833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.826171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.826899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.828882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.857425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1132/2329] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:01.858429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.884522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1198/2330] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:01.895018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.896462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.908333 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75776d-d99a-4692-befb-22b501e38336 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.925700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53949b-0d07-4689-9054-74db0fec186d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.930717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.931376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.931656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.931928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.932608 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.934543 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.956033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1133/2331] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:01.957191 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.957831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.958107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.958374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.960111 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.969817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b13f-c4f0-485b-9c47-35caefcc4210 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.976092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.976819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.977102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.977728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.978456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.979731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.991535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1134/2332] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:01.995735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.005958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a5b25-6630-462e-81d5-4240f8ea5e29 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.012332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.013092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.013383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.013658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.014390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.015984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.028714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1135/2333] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:02.033066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.036442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.039067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1d0cc-a2c7-4376-82db-d2aa3714896e service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.044450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72040-9daf-44bb-a187-b3f9addcc4ab admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.050017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.050941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.051468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.051650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] PATH_INFO: `/v3/projects/d7ba76ae23eb4c0294656489d1c9c09a/users/7237368affa54d89b4c1c665d6c62b97/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.056471 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1199/2334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:02.073382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ba76ae23eb4c0294656489d1c9c09a, user_id=7237368affa54d89b4c1c665d6c62b97, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.076199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.091453 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1136/2335] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:02 2022] PUT /identity/v3/projects/d7ba76ae23eb4c0294656489d1c9c09a/users/7237368affa54d89b4c1c665d6c62b97/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:02.102989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.103357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.103642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.141185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] MFA Rules not processed for user `7237368affa54d89b4c1c665d6c62b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:02.142384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.235623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1200/2336] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:02.240052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.321702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2c087-284c-4d9b-9175-f99b452202a1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.327900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.330817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.331349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.332896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.333822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.336519 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.377729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1137/2337] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:02.381491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.392998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcd02e-252e-4215-9796-3e5760b6f2bf None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.476376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.477097 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.477377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.477645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.478418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.480367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.504059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1201/2338] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:02.508122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.519480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bac2-8cf9-4fac-afd0-a220304eabab admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.524440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.525158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.525437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.525710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.526443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.528050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.542557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1138/2339] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:02.543746 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.556074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce4c1-9e59-4b04-9f3a-0cce6a05a497 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.562387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.563247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.563488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.563788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] PATH_INFO: `/v3/projects/69743c420bf047f7949ae828b7c78aa6/users/724d54c9879a4ee08cbbf904c7421b3e/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.581222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69743c420bf047f7949ae828b7c78aa6, user_id=724d54c9879a4ee08cbbf904c7421b3e, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.584367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.604703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1202/2340] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:02 2022] PUT /identity/v3/projects/69743c420bf047f7949ae828b7c78aa6/users/724d54c9879a4ee08cbbf904c7421b3e/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:02.607661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.619931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49966a-a1ff-4e9e-94d1-12d066a475b5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.683756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.684749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.685555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.685839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.686709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.688320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6f8b-a764-43ca-bcd2-1463820a0a5b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.701708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1139/2341] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:02.705735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.725648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731e7d-1276-440b-85e9-220895b76375 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.731283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.732108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.732388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.732677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] PATH_INFO: `/v3/projects/69743c420bf047f7949ae828b7c78aa6/users/724d54c9879a4ee08cbbf904c7421b3e/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.734640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69743c420bf047f7949ae828b7c78aa6, user_id=724d54c9879a4ee08cbbf904c7421b3e, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.737318 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.752290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1203/2342] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:02 2022] PUT /identity/v3/projects/69743c420bf047f7949ae828b7c78aa6/users/724d54c9879a4ee08cbbf904c7421b3e/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:02.763961 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.764323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.764684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.792676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] MFA Rules not processed for user `724d54c9879a4ee08cbbf904c7421b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:02.793950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.864184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1140/2343] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:02.876094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.877784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.936153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96987de5-5903-455f-909e-a3c9db616a41 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.939693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.940332 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.940607 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.940913 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.950622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.952026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c8c7-5480-41a3-b0f7-d28b04fe989c service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.964756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1204/2344] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:03.036882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.046802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463017e-9350-483d-8714-bbc516c4ae5d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.050588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.051281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.051563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.051835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.117722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.121290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:03.128979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1141/2345] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:03.935406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.935866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.935962 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.953581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:03.954757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.007781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1205/2346] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:04.019588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.021001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.089001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680784d9-01f7-41f1-b136-280c28859334 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.093904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.094568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.094846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.095145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.104230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.105862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5516a4-9cac-46e4-8954-c6ca912956ed service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.113962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1142/2347] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:20:13.821548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.881551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c1f53-b765-4c6e-948b-39302d2a2d01 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.886469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.887325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.887600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.887871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] PATH_INFO: `/v3/users/7237368affa54d89b4c1c665d6c62b97` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.889047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7237368affa54d89b4c1c665d6c62b97)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.890939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.935537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7237368affa54d89b4c1c665d6c62b97'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:13.941946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7237368affa54d89b4c1c665d6c62b97'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:13.942599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7237368affa54d89b4c1c665d6c62b97'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:13.949563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7237368affa54d89b4c1c665d6c62b97'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:13.950400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7237368affa54d89b4c1c665d6c62b97'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:13.967770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1206/2348] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:13 2022] DELETE /identity/v3/users/7237368affa54d89b4c1c665d6c62b97 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:13.972343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.972896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.972896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.990240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:13.991905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:14.046965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1143/2349] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:14.057473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.058835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:14.112373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352cb8-d097-437d-b824-076c6c840964 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:14.116642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:14.117299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:14.117580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:14.117850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.126467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:14.127863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:14.137114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1207/2350] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:14.401978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.403581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:14.427592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85b96-c7dc-41b2-ac44-28f2d8dc7c4e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:14.434312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:14.435186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:14.435467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:14.435740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] PATH_INFO: `/v3/projects/d7ba76ae23eb4c0294656489d1c9c09a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.436976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ba76ae23eb4c0294656489d1c9c09a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:14.438894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:14.486290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ba76ae23eb4c0294656489d1c9c09a', 'request_id': 'req-b65e204b-586b-4127-bde7-5b16d158c479'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.492577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ba76ae23eb4c0294656489d1c9c09a', 'request_id': 'req-b65e204b-586b-4127-bde7-5b16d158c479'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.499998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ba76ae23eb4c0294656489d1c9c09a', 'request_id': 'req-b65e204b-586b-4127-bde7-5b16d158c479'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.511707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] The token cache is being invalidate because project d7ba76ae23eb4c0294656489d1c9c09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:14.511982 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.512698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.514243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1144/2351] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:14 2022] DELETE /identity/v3/projects/d7ba76ae23eb4c0294656489d1c9c09a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:14.518118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.527761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2612f-4b78-4339-b8ba-3eee676abc14 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:14.588714 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:14.589974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:14.590418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:14.590887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] PATH_INFO: `/v3/users/724d54c9879a4ee08cbbf904c7421b3e` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.592270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724d54c9879a4ee08cbbf904c7421b3e)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:14.594388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:14.652865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724d54c9879a4ee08cbbf904c7421b3e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.660258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724d54c9879a4ee08cbbf904c7421b3e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.660952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724d54c9879a4ee08cbbf904c7421b3e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.670751 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724d54c9879a4ee08cbbf904c7421b3e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.671552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-70eccc3c-2873-410e-a210-491f395a5e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724d54c9879a4ee08cbbf904c7421b3e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:14.691634 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1208/2352] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:14 2022] DELETE /identity/v3/users/724d54c9879a4ee08cbbf904c7421b3e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:14.983902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.985367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.002290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e204b-586b-4127-bde7-5b16d158c479 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.060043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.061023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.061451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.061733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] PATH_INFO: `/v3/projects/69743c420bf047f7949ae828b7c78aa6` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.063007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69743c420bf047f7949ae828b7c78aa6)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.065099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.110582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69743c420bf047f7949ae828b7c78aa6', 'request_id': 'req-b1b3a736-747c-44ac-9313-9b4cce275676'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.115777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69743c420bf047f7949ae828b7c78aa6', 'request_id': 'req-b1b3a736-747c-44ac-9313-9b4cce275676'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.122225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69743c420bf047f7949ae828b7c78aa6', 'request_id': 'req-b1b3a736-747c-44ac-9313-9b4cce275676'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.133618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] The token cache is being invalidate because project 69743c420bf047f7949ae828b7c78aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:15.133900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.134558 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b1b3a736-747c-44ac-9313-9b4cce275676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.136080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1145/2353] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:14 2022] DELETE /identity/v3/projects/69743c420bf047f7949ae828b7c78aa6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:15.140922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.141398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.141502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.160086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:15.161290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.217221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1209/2354] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:15.225857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.226115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.226387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.244109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:15.245690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.252991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1146/2355] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:15.257546 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.267033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d7f8-0ff4-427b-8c0f-cebdcf424b4a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.272493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.273209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.273489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.273757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.274494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:15.274802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.276405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.289056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1210/2356] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:15.293350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.302174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb7ea6-b78b-4c19-878c-640e9b60a1b2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.306749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.307392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.307666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.307931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.308619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.310570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.339230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1147/2357] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:15.343356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.353900 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6311de-2004-4a6a-a958-75c66b60e9e1 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.407552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.408208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.408488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.408802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.409485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.411377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.431100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1211/2358] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:15.435590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.446289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad01af-d06c-434f-aac6-eb861f52e318 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.451342 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.452098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.452376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.452668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.453482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.455161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.466148 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1148/2359] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:15.470014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.479747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d0c61-002e-44f9-99fc-c2dcb6e5a511 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.484262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.484970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.485260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.485624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.486502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.488320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38a05f-c198-4113-8950-185a28393f96 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.499165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1212/2360] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:15.503100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.513540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f6507-35fd-454e-a3f7-8d4d8a30b4b4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.518154 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.519017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.519290 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.519557 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] PATH_INFO: `/v3/projects/2c43e0d8645142c0941b694e79528a50/users/7493e723dca6499891500f70bf76019f/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.534521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c43e0d8645142c0941b694e79528a50, user_id=7493e723dca6499891500f70bf76019f, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.537185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.549457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1149/2361] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:15 2022] PUT /identity/v3/projects/2c43e0d8645142c0941b694e79528a50/users/7493e723dca6499891500f70bf76019f/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:15.560448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.560776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.561057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.589203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] MFA Rules not processed for user `7493e723dca6499891500f70bf76019f`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:15.590395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.651325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1213/2362] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:15.656017 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.715302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed3b4-75c0-4d55-b5ef-57f45ce19a44 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.719788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.720433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.720738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.721009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.721694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.723567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.747647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1150/2363] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:15.751617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.762999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b418fc-c63f-40e8-96be-507e575b4f95 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.820418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.821130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.821410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.821708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.822393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.824323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.843378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1214/2364] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:15.847235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.858098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f608-2861-46a5-a1e8-8eef26cb5b58 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.862700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.863359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.863644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.863916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.864636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.866969 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.880399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1151/2365] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:15.882689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.892484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbb0ca-5d0c-4bfb-ae1b-2af0bca5705f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.899033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.899919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.900198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.900473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] PATH_INFO: `/v3/projects/1238227870454b389267709f3edf5434/users/f23735f989ac4255a41785c579c6ab0f/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.924974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1238227870454b389267709f3edf5434, user_id=f23735f989ac4255a41785c579c6ab0f, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.927683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.941261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1215/2366] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:15 2022] PUT /identity/v3/projects/1238227870454b389267709f3edf5434/users/f23735f989ac4255a41785c579c6ab0f/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:15.945168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.955445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806383-4456-4394-a56f-bf5b1d1d692e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.011242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.011894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.012157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.012429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.013212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.014796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc648d-f898-48e6-8f15-52f81ed7dbcc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.025431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1152/2367] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:16.029659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.040824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872caca-1f7c-415f-80dc-88d9c7018703 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.045516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.046399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.046683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.046957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] PATH_INFO: `/v3/projects/1238227870454b389267709f3edf5434/users/f23735f989ac4255a41785c579c6ab0f/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.048976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1238227870454b389267709f3edf5434, user_id=f23735f989ac4255a41785c579c6ab0f, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.051610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.068452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1216/2368] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:16 2022] PUT /identity/v3/projects/1238227870454b389267709f3edf5434/users/f23735f989ac4255a41785c579c6ab0f/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:16.078467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.078751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.079027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.105640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] MFA Rules not processed for user `f23735f989ac4255a41785c579c6ab0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:16.106882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.174768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1153/2369] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:16.185587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.190668 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.261306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285447e-61fa-4ab4-92f2-b34286f0a243 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.264840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.265503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.265763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.266037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.275608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.277056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6450fc4-e5a3-422f-8ac8-4a6088f68b72 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.286669 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1217/2370] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:16.365385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.374913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f830-772a-4e8b-b846-1b65ba5f8151 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.379745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.380391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.381227 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.382048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.437720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.439156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.448106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1154/2371] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:19.874303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:19.874758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:19.874858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:19.892115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:19.893327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:19.946340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1218/2372] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:20:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:19.958425 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:19.960532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.027894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b1dc-86bd-4ca9-b69c-4660a9cb772c service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.033092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.033726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.034005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.034275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.042248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.043786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5ba9-7b77-46c2-a1f0-49cd217fc112 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.051732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1155/2373] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:20:20.439369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:20.511685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c43f-2e72-4af4-9232-e197d6f4118e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.516163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.517046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.517330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.517602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] PATH_INFO: `/v3/users/7493e723dca6499891500f70bf76019f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.518811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7493e723dca6499891500f70bf76019f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.522310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.586657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7493e723dca6499891500f70bf76019f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.594135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7493e723dca6499891500f70bf76019f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.594973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7493e723dca6499891500f70bf76019f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.608468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7493e723dca6499891500f70bf76019f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.609159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7493e723dca6499891500f70bf76019f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.642645 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1219/2374] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:20 2022] DELETE /identity/v3/users/7493e723dca6499891500f70bf76019f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:20.648009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.648264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.648589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.686249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:20.687962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.765174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1156/2375] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:20.777364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:20.784107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.875240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb392ec-9b2f-4e07-9979-7375e5d93577 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.878873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.879685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.881520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.881520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.893671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.895088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.906543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1220/2376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:21.205197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.207958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:21.225198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e8f91-e93a-473d-a78d-21e94d4d7db6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.229974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.231229 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.232150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.232150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] PATH_INFO: `/v3/projects/2c43e0d8645142c0941b694e79528a50` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.233314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c43e0d8645142c0941b694e79528a50)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.235348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.291652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c43e0d8645142c0941b694e79528a50', 'request_id': 'req-19456b24-a7d0-48f2-9f6c-9a114afd81d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.296876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c43e0d8645142c0941b694e79528a50', 'request_id': 'req-19456b24-a7d0-48f2-9f6c-9a114afd81d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.305160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c43e0d8645142c0941b694e79528a50', 'request_id': 'req-19456b24-a7d0-48f2-9f6c-9a114afd81d3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.319062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] The token cache is being invalidate because project 2c43e0d8645142c0941b694e79528a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:21.319339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.319988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.321601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1157/2377] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:21 2022] DELETE /identity/v3/projects/2c43e0d8645142c0941b694e79528a50 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:21.325552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.337628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ad4b3-2fa0-4fce-997a-8f765001a759 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.398882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.399655 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.399936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.400204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] PATH_INFO: `/v3/users/f23735f989ac4255a41785c579c6ab0f` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.401492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23735f989ac4255a41785c579c6ab0f)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.403392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.456983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23735f989ac4255a41785c579c6ab0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.466051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23735f989ac4255a41785c579c6ab0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.466736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23735f989ac4255a41785c579c6ab0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.473878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23735f989ac4255a41785c579c6ab0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.475183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-80cf2f0b-3bde-4594-b424-79a617355c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23735f989ac4255a41785c579c6ab0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.494312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1221/2378] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:21 2022] DELETE /identity/v3/users/f23735f989ac4255a41785c579c6ab0f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:21.760921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.762472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:21.791905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19456b24-a7d0-48f2-9f6c-9a114afd81d3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.858972 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.860061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.860407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.860780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] PATH_INFO: `/v3/projects/1238227870454b389267709f3edf5434` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.862340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1238227870454b389267709f3edf5434)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.864442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.926433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1238227870454b389267709f3edf5434', 'request_id': 'req-1351b0ed-762f-4c38-9adb-7cb376fb9672'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.934012 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1238227870454b389267709f3edf5434', 'request_id': 'req-1351b0ed-762f-4c38-9adb-7cb376fb9672'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.942788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1238227870454b389267709f3edf5434', 'request_id': 'req-1351b0ed-762f-4c38-9adb-7cb376fb9672'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.957631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] The token cache is being invalidate because project 1238227870454b389267709f3edf5434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:21.957943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.958690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1351b0ed-762f-4c38-9adb-7cb376fb9672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:21.964753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1158/2379] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:21 2022] DELETE /identity/v3/projects/1238227870454b389267709f3edf5434 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:21.966154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.966686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.966965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.988331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:21.989561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:22.058283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1222/2380] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:22.066407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.066538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.066779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.090585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:22.091937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:22.104929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1159/2381] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:22.107472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.117960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d339c-62a1-4dd1-9188-6eacd61146d2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.123369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.124035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.124315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.124684 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.125491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:22.125631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.127400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.139978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1223/2382] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:22.144303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.156372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f516e-4681-48b2-b158-efe9fc24bd69 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.161406 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.162239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.162515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.162783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.163479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.165430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.192747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1160/2383] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:22.197398 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.207201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e72f4c-fbbe-4e8e-b265-dc88e207daf8 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.263649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.264312 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.264615 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.264912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.265584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.267473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.286372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1224/2384] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:22.291259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.301469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412572f-3be9-4256-ba43-ff12c6f87907 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.306780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.307433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.307712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.307983 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.308731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.310319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.320561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1161/2385] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:22.324663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.334400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191eef-2961-4366-8c5b-03991b8ab146 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.338955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.339598 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.339875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.340145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.340949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.342682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0e45-beba-4f9a-a7d2-bb99dfeb6b40 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.352866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1225/2386] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:22.356936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.368046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc73ad-cdc0-49ad-b75e-b192152e4fa4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.372606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.373520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.373800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.374063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] PATH_INFO: `/v3/projects/e7d0b50241de4c30b52b7668b0ba2be2/users/4ca181094bc04e31bba42db0a918ded0/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.387991 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d0b50241de4c30b52b7668b0ba2be2, user_id=4ca181094bc04e31bba42db0a918ded0, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.390641 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.402870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1162/2387] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:22 2022] PUT /identity/v3/projects/e7d0b50241de4c30b52b7668b0ba2be2/users/4ca181094bc04e31bba42db0a918ded0/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:22.414665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2d3f-e741-4052-abd5-050de410691e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.414957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2d3f-e741-4052-abd5-050de410691e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.415235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2d3f-e741-4052-abd5-050de410691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.441919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-824e2d3f-e741-4052-abd5-050de410691e None None] MFA Rules not processed for user `4ca181094bc04e31bba42db0a918ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:22.444214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-824e2d3f-e741-4052-abd5-050de410691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:22.508812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1226/2388] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:22.513568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.574830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2a90d-3656-4821-99ac-5e3ae0402aa2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.579411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.580062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.580340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.580613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.581336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.583221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.607303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1163/2389] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:22.611335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2d3f-e741-4052-abd5-050de410691e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.622095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2d3f-e741-4052-abd5-050de410691e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.675511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.676163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.676440 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.676736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.677986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.679863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.699694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1227/2390] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:22.703511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.713589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071fe86-8caf-44b4-a593-4ac0720d9c4d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.718415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.719070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.719348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.719621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.720340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.721966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.732225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1164/2391] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:22.736336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.746786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593fa0-bd1a-4009-be0e-c18edef89897 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.751336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.752197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.752482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.752793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] PATH_INFO: `/v3/projects/98f19ffd31394deb886c1e681bf1b28a/users/7e3d4f23598547bf9562309980272778/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.768196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f19ffd31394deb886c1e681bf1b28a, user_id=7e3d4f23598547bf9562309980272778, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.771553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.784512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1228/2392] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:22 2022] PUT /identity/v3/projects/98f19ffd31394deb886c1e681bf1b28a/users/7e3d4f23598547bf9562309980272778/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:22.789397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.799402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0aed-2851-44be-9ed5-628e617d9ea8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.853133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.853793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.854068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.854338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.855109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.856744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1856612-ddb2-42ac-84be-954ce1944100 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.866436 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1165/2393] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:22.870586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:22.880322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0ab4-5705-46ce-bc86-09a9ffe941ac admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:22.885200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:22.886072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.886351 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.886625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] PATH_INFO: `/v3/projects/98f19ffd31394deb886c1e681bf1b28a/users/7e3d4f23598547bf9562309980272778/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.888766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f19ffd31394deb886c1e681bf1b28a, user_id=7e3d4f23598547bf9562309980272778, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:22.891393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:22.902058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1229/2394] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:22 2022] PUT /identity/v3/projects/98f19ffd31394deb886c1e681bf1b28a/users/7e3d4f23598547bf9562309980272778/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:22.912938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:22.913223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:22.913498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:22.938242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] MFA Rules not processed for user `7e3d4f23598547bf9562309980272778`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:22.939414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:23.002762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1166/2395] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:23.013739 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:23.015457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:23.071888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248ba59-a62c-4d71-9b50-158df75e0d69 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:23.075563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:23.076198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.076476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.076882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.086216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:23.087623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47683b77-e9c8-418e-9da8-bbd042f7eadf service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:23.097120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1230/2396] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:23.235324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:23.297134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c266-0c4a-45f4-87b2-e27183ff4c95 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:23.301706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:23.303129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.303411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.303679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] PATH_INFO: `/v3/users/4ca181094bc04e31bba42db0a918ded0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.304953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca181094bc04e31bba42db0a918ded0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:23.306862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:23.352101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca181094bc04e31bba42db0a918ded0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.359336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca181094bc04e31bba42db0a918ded0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.367451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca181094bc04e31bba42db0a918ded0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.368189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca181094bc04e31bba42db0a918ded0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.368831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca181094bc04e31bba42db0a918ded0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.386992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1167/2397] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:23 2022] DELETE /identity/v3/users/4ca181094bc04e31bba42db0a918ded0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:23.391493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.391783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.392061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.409474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:23.410639 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:23.466524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1231/2398] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:23.476053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:23.477492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:23.533457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed642-d86e-43dc-9e84-8bfd7b3b3585 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:23.537015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:23.537650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.537923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.538187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.546825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:23.548232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:23.557838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1168/2399] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:23.816717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:23.818815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:23.832869 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31afac-e36c-404e-9968-835fb5d5f72a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:23.839497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:23.840236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.840485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.840777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] PATH_INFO: `/v3/projects/e7d0b50241de4c30b52b7668b0ba2be2` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.842371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d0b50241de4c30b52b7668b0ba2be2)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:23.843959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:23.889319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d0b50241de4c30b52b7668b0ba2be2', 'request_id': 'req-a36feb82-5297-4373-95e2-2efba90320ef'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.894564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d0b50241de4c30b52b7668b0ba2be2', 'request_id': 'req-a36feb82-5297-4373-95e2-2efba90320ef'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.902534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d0b50241de4c30b52b7668b0ba2be2', 'request_id': 'req-a36feb82-5297-4373-95e2-2efba90320ef'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.913631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] The token cache is being invalidate because project e7d0b50241de4c30b52b7668b0ba2be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:23.913915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.914525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:23.916053 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1232/2400] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:23 2022] DELETE /identity/v3/projects/e7d0b50241de4c30b52b7668b0ba2be2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:23.920009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:23.929740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c1ae9-b651-4203-9396-9a6833adaa64 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:23.988628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:23.989534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:23.989920 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:23.990388 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] PATH_INFO: `/v3/users/7e3d4f23598547bf9562309980272778` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:23.991619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3d4f23598547bf9562309980272778)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:23.993559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.039855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3d4f23598547bf9562309980272778'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.046303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3d4f23598547bf9562309980272778'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.054507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3d4f23598547bf9562309980272778'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.055199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3d4f23598547bf9562309980272778'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.055836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66e0ef0d-ed25-4e83-9485-d184ba8a4f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3d4f23598547bf9562309980272778'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.073731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1169/2401] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:23 2022] DELETE /identity/v3/users/7e3d4f23598547bf9562309980272778 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:24.360933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.362690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:24.378075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36feb82-5297-4373-95e2-2efba90320ef admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.451303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.452182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.452463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.452775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] PATH_INFO: `/v3/projects/98f19ffd31394deb886c1e681bf1b28a` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.453936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f19ffd31394deb886c1e681bf1b28a)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.455819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.506152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f19ffd31394deb886c1e681bf1b28a', 'request_id': 'req-989cabac-dee2-4002-99b1-707b944322ed'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.511417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f19ffd31394deb886c1e681bf1b28a', 'request_id': 'req-989cabac-dee2-4002-99b1-707b944322ed'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.518420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f19ffd31394deb886c1e681bf1b28a', 'request_id': 'req-989cabac-dee2-4002-99b1-707b944322ed'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.530299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] The token cache is being invalidate because project 98f19ffd31394deb886c1e681bf1b28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:24.530583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.531257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-989cabac-dee2-4002-99b1-707b944322ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:24.532867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1233/2402] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:24 2022] DELETE /identity/v3/projects/98f19ffd31394deb886c1e681bf1b28a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:24.538391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.538857 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.538974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.557177 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:24.558486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:24.614076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1170/2403] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:24.622537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.622821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.623094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.640838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:24.642047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:24.650078 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1234/2404] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:24.654134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.664810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4a069-efbc-4506-9c8b-166b38296070 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.669317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.670073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.670417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.670751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.671658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:24.672026 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.673628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.685487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1171/2405] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:24.689693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.699240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46904b80-b6a6-4bbb-8422-0f90289a65f1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.704533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.705274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.705539 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.705814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.706578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.708514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.733446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1235/2406] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:24.737553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.748698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2550-e28f-4f46-a888-32df45a492f6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.804936 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.805596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.805873 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.806143 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.806844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.808876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.828431 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1172/2407] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:24.832389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.842808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af78671-aab1-4038-a21c-7d998324d9e9 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.847289 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.847958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.848235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.848503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.849866 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.851566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.861791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1236/2408] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:24.866234 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.875844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09838-fba8-4498-80a9-fa65b021313c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.880498 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.881284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.881545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.881812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.882517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.884091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce9b39-48b0-4199-8ae1-cdc9b5a3cae2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.893625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1173/2409] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:24.898537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.908672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb683a9-1bc8-42cc-b975-8b9eecffe78e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:24.914494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:24.915374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.915646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.915914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] PATH_INFO: `/v3/projects/2574aa4c46f649fc8c39fafc7dca7857/users/89a66ca931b94337bcaef1fb1d8a462b/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.931310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2574aa4c46f649fc8c39fafc7dca7857, user_id=89a66ca931b94337bcaef1fb1d8a462b, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:24.933964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:24.947128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1237/2410] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:24 2022] PUT /identity/v3/projects/2574aa4c46f649fc8c39fafc7dca7857/users/89a66ca931b94337bcaef1fb1d8a462b/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:24.958167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.958960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.959232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.985521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] MFA Rules not processed for user `89a66ca931b94337bcaef1fb1d8a462b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:24.986714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.048246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1174/2411] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:25.053015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.111587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c600-a896-4f28-910f-8e5bb339d009 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.116476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.117091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.117369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.117638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.118306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.120168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.153271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1238/2412] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:25.157444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.168365 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7cc0d-8407-487f-b6bf-46cf2e7f80f3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.221006 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.221663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.221938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.222207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.222894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.224932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.244337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1175/2413] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:25.248373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.258892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5998-3117-460a-afa3-816b6c70f45d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.263386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.264031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.264311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.264586 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.265344 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.266927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.280226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1239/2414] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:25.281706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.291665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a83-d3cf-43b3-b74f-91d02139490f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.296207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.296911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.297198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.297473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.298192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.300047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68e5ad-e3ae-49d8-a23c-a2a2124bf782 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.309916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1176/2415] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:25.314038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.326510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfa8c2-6018-4be1-a3b7-0bc6ce4aac89 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.330978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.331841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.332120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.332392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] PATH_INFO: `/v3/projects/6f2d22d8d3274240b15b0688b171946d/users/4e8b0a2b5fe74aedb4a353cbcf9f692e/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.347099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2d22d8d3274240b15b0688b171946d, user_id=4e8b0a2b5fe74aedb4a353cbcf9f692e, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.349786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.361951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1240/2416] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:25 2022] PUT /identity/v3/projects/6f2d22d8d3274240b15b0688b171946d/users/4e8b0a2b5fe74aedb4a353cbcf9f692e/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:25.372100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.372327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.372599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.399277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] MFA Rules not processed for user `4e8b0a2b5fe74aedb4a353cbcf9f692e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:25.400455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.461950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1177/2417] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:25.466754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.526214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd81d0c-8404-4a1c-9398-2593546273a0 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.531266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.531917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.532193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.532465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.533172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.535035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.559375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1241/2418] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:25.563523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.574750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33628f8d-c10a-421f-9b16-a727b374d3c0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.627840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.628421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.628722 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.628998 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.629674 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.632242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.651430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1178/2419] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:25.655673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.666055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9dfc0-65c7-4d28-bfb2-844a120e8439 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.670602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.671248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.671526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.671796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.672509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.674102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.684733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1242/2420] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:25.688609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.699105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a611bb7-8cb4-4d25-8209-413379b0523e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.703670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.704563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.704875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.705149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] PATH_INFO: `/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd/users/93624f830d054665931dff8f944be7e2/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.720763 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec50de2a3974ef396ab30e0a2ce11fd, user_id=93624f830d054665931dff8f944be7e2, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.723368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.735736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1179/2421] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:25 2022] PUT /identity/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd/users/93624f830d054665931dff8f944be7e2/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:25.740165 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.750389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258131-aa22-41a3-97b1-ee57432724c2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.806133 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.806789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.807069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.807341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.808049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.809649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7077-1136-442b-b9c0-891e3d7e52a2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.819197 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1243/2422] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:25.823354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.833904 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b0a2d-9ef4-4376-85dd-7612b600d063 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.839028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.839898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.840178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.840452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] PATH_INFO: `/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd/users/93624f830d054665931dff8f944be7e2/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.842421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec50de2a3974ef396ab30e0a2ce11fd, user_id=93624f830d054665931dff8f944be7e2, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.845135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.856690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1180/2423] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:25 2022] PUT /identity/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd/users/93624f830d054665931dff8f944be7e2/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:25.867993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.868285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.868565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.893695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] MFA Rules not processed for user `93624f830d054665931dff8f944be7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:25.894812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.960619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1244/2424] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:25.971997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.973892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.029887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66690e8b-1837-45f4-bc7e-0b0527fa4ec4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.033710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.034338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.034612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.034879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.091344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.092810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.102002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1181/2425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:27.564383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.565834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.578115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c90f08-d680-48f9-af82-85ed436dbe8e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.581606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.582387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.582682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.582942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.637838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.639168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.648258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1245/2426] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:28.144795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.153159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954265d-ebc8-4824-a94f-564c382e69a5 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.156968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.157531 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.157805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.158074 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.166788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.168215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371ec66-234f-40bd-8160-5a734fdf511f service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.177879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1182/2427] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:31.985631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:32.048414 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af8b5-64b7-41ed-9db7-29f88426b5b4 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:32.052861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:32.053884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:32.054101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:32.054370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] PATH_INFO: `/v3/users/89a66ca931b94337bcaef1fb1d8a462b` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:32.055533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a66ca931b94337bcaef1fb1d8a462b)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:32.057476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:32.101952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a66ca931b94337bcaef1fb1d8a462b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.108326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a66ca931b94337bcaef1fb1d8a462b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.108983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a66ca931b94337bcaef1fb1d8a462b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.115738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a66ca931b94337bcaef1fb1d8a462b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.116403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a66ca931b94337bcaef1fb1d8a462b'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.133256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1246/2428] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:31 2022] DELETE /identity/v3/users/89a66ca931b94337bcaef1fb1d8a462b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:32.137684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:32.138162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:32.138258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:32.155770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:32.157015 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:32.214874 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1183/2429] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:32.224560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:32.226383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:32.285402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfdc11-0f2d-4823-87e5-0a47f7c04eff admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:32.289219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:32.289872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:32.290152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:32.290425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:32.300094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:32.301555 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:32.313029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1247/2430] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:32.577102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:32.578530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:32.591633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5b03-ba79-4bdd-ac9c-698b60ac5b71 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:32.596376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:32.598409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:32.598803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:32.599195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] PATH_INFO: `/v3/projects/2574aa4c46f649fc8c39fafc7dca7857` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:32.600774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2574aa4c46f649fc8c39fafc7dca7857)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:32.603182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:32.648399 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2574aa4c46f649fc8c39fafc7dca7857', 'request_id': 'req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.653938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2574aa4c46f649fc8c39fafc7dca7857', 'request_id': 'req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.660868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2574aa4c46f649fc8c39fafc7dca7857', 'request_id': 'req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.672084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] The token cache is being invalidate because project 2574aa4c46f649fc8c39fafc7dca7857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:32.672362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.672994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.674528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1184/2431] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:32 2022] DELETE /identity/v3/projects/2574aa4c46f649fc8c39fafc7dca7857 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:32.679048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:32.688541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731be7c-a460-407d-982e-0fe476608044 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:32.741698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:32.742484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:32.742758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:32.743027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] PATH_INFO: `/v3/users/4e8b0a2b5fe74aedb4a353cbcf9f692e` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:32.744196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8b0a2b5fe74aedb4a353cbcf9f692e)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:32.746119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:32.789067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8b0a2b5fe74aedb4a353cbcf9f692e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.795472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8b0a2b5fe74aedb4a353cbcf9f692e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.796110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8b0a2b5fe74aedb4a353cbcf9f692e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.802775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8b0a2b5fe74aedb4a353cbcf9f692e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.804431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8b0a2b5fe74aedb4a353cbcf9f692e'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:32.820885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1248/2432] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:32 2022] DELETE /identity/v3/users/4e8b0a2b5fe74aedb4a353cbcf9f692e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:33.081962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.083473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.097191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e6c0-dd0d-48f0-96de-35743e5f2ca7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.152723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.153579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.153859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.154138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] PATH_INFO: `/v3/projects/6f2d22d8d3274240b15b0688b171946d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.155650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2d22d8d3274240b15b0688b171946d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.157635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.201362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2d22d8d3274240b15b0688b171946d', 'request_id': 'req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.206553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2d22d8d3274240b15b0688b171946d', 'request_id': 'req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.214329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2d22d8d3274240b15b0688b171946d', 'request_id': 'req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.224890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] The token cache is being invalidate because project 6f2d22d8d3274240b15b0688b171946d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:33.225868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.226397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.227899 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1185/2433] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:33 2022] DELETE /identity/v3/projects/6f2d22d8d3274240b15b0688b171946d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:33.231867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.233284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.245779 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80a048-485e-44b2-8e31-eaeac5249498 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.299349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.300158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.300443 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.300754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] PATH_INFO: `/v3/users/93624f830d054665931dff8f944be7e2` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.301968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93624f830d054665931dff8f944be7e2)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.304682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.348494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93624f830d054665931dff8f944be7e2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.355280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93624f830d054665931dff8f944be7e2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.355987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93624f830d054665931dff8f944be7e2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.363963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93624f830d054665931dff8f944be7e2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.364638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-01f6a066-3eaa-4546-bf5d-c45fca63c4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93624f830d054665931dff8f944be7e2'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.383921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1249/2434] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:33 2022] DELETE /identity/v3/users/93624f830d054665931dff8f944be7e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:33.646473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.648120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.670378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b8078-e9a7-430c-9fc2-3ffcb916f1ae admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.724886 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.727073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.727358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.727646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] PATH_INFO: `/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.729061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec50de2a3974ef396ab30e0a2ce11fd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.731300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.775902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec50de2a3974ef396ab30e0a2ce11fd', 'request_id': 'req-a07e426e-c061-44c6-9bb0-88287c9667b1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.783300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec50de2a3974ef396ab30e0a2ce11fd', 'request_id': 'req-a07e426e-c061-44c6-9bb0-88287c9667b1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.793939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec50de2a3974ef396ab30e0a2ce11fd', 'request_id': 'req-a07e426e-c061-44c6-9bb0-88287c9667b1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.804805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] The token cache is being invalidate because project dec50de2a3974ef396ab30e0a2ce11fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:33.805085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.805696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a07e426e-c061-44c6-9bb0-88287c9667b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:33.807247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1186/2435] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:33 2022] DELETE /identity/v3/projects/dec50de2a3974ef396ab30e0a2ce11fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:33.812069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c097c-1891-458b-b684-35069dda0045 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.812358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c097c-1891-458b-b684-35069dda0045 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.812636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c097c-1891-458b-b684-35069dda0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.830690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-164c097c-1891-458b-b684-35069dda0045 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:33.831788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-164c097c-1891-458b-b684-35069dda0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.888632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1250/2436] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:33.896312 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.896620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.897782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.916251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:33.917459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.925228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1187/2437] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:33.929275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c097c-1891-458b-b684-35069dda0045 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.938781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c097c-1891-458b-b684-35069dda0045 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.943356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.944005 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.944287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.944562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.945319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:33.945626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.947208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.958420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1251/2438] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:33.963110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.972188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b229ed-af25-41a0-94b3-fa76fdd972c7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.977726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.978422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.978703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.978975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.979659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.981596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.005694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1188/2439] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:34.009662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:34.019365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc3c5-8c1e-4667-8d06-40b29a82d1d2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:34.074371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:34.075051 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.075338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.075616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.076315 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:34.078278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.098269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1252/2440] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:34 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:34.103112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:34.113565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871e15-961a-4b7b-bea0-c0af3a32d877 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:34.118130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:34.118775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.119049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.119316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.120028 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:34.121632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.131897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1189/2441] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:34.135734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:34.145384 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea183e-db14-48a1-8b4b-1ccc56f29cb5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:34.151007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:34.151679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.151960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.152236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.152991 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:34.154567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e579bd-89d0-4af0-bd1c-62df0a2075f8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.166184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1253/2442] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:34.170050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:34.179796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9099f1-8bbc-4495-8f54-639675420cf3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:34.184321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:34.185219 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.185496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.185764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] PATH_INFO: `/v3/projects/21a8caef9eca4a1c9dfcd4a5d7195443/users/d5a7722f88474e4c854863205daba9a7/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.200221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a8caef9eca4a1c9dfcd4a5d7195443, user_id=d5a7722f88474e4c854863205daba9a7, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:34.202937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.216309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1190/2443] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:34 2022] PUT /identity/v3/projects/21a8caef9eca4a1c9dfcd4a5d7195443/users/d5a7722f88474e4c854863205daba9a7/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:34.226531 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf0ba-679a-4542-977e-d71741ad969d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.226812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf0ba-679a-4542-977e-d71741ad969d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.227087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf0ba-679a-4542-977e-d71741ad969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.253858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-95adf0ba-679a-4542-977e-d71741ad969d None None] MFA Rules not processed for user `d5a7722f88474e4c854863205daba9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:34.255042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-95adf0ba-679a-4542-977e-d71741ad969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:34.317633 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1254/2444] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:34.328537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:34.330271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:34.387652 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ac82-48b7-4922-be25-7c629a0b7813 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:34.391205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:34.391848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:34.392126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:34.392394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:34.401199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:34.402665 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:34.411575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1191/2445] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:35.800562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6510f-8919-4c6f-ac68-229a572c9a53 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:35.801142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6510f-8919-4c6f-ac68-229a572c9a53 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:35.801142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6510f-8919-4c6f-ac68-229a572c9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:35.820185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-47a6510f-8919-4c6f-ac68-229a572c9a53 None None] MFA Rules not processed for user `d5a7722f88474e4c854863205daba9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:35.821417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-47a6510f-8919-4c6f-ac68-229a572c9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:35.835496 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1255/2446] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:50.873466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:50.874926 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:50.931378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710560d5-f390-4c05-adb9-081a35a94b00 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:50.934946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:50.935828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:50.936109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:50.936381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:50.938221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:51.002460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:51.003884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:51.013613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1192/2447] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:53.548821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515a6d-b9f3-45e4-a3e7-0e05afab94d7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:53.549326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515a6d-b9f3-45e4-a3e7-0e05afab94d7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:53.549427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515a6d-b9f3-45e4-a3e7-0e05afab94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:53.569950 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-8c515a6d-b9f3-45e4-a3e7-0e05afab94d7 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:53.572087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-8c515a6d-b9f3-45e4-a3e7-0e05afab94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:53.630379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1256/2448] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:53.653701 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:53.655354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:53.722108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd921cd-84bc-4809-affd-ab3c4aac58a0 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:53.727946 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:53.728604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:53.728937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:53.729334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:53.738821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:53.741834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:53.753764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1193/2449] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:20:54.540270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:54.540564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:54.540916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:54.565137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:54.566342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:54.576818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1257/2450] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:54.602448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:54.618610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0538-726f-4688-8c5d-3ef38ce7afd8 service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:54.625434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:54.627294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:54.627792 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:54.628250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:54.654208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:54.656609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90de5-3679-42db-8de9-86f9d0506008 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:54.704459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1194/2451] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:20:54.848512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:54.851193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:54.867478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488e3eb-79c6-44e3-982a-5bf2896ad3f9 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:54.872035 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:54.872928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:54.873208 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:54.873472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] PATH_INFO: `/v3/users/314a5e1a357c4a73a33391b6f25a44c6` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:54.874847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314a5e1a357c4a73a33391b6f25a44c6)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:54.876774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:54.915508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:54.915791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:54.916069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:54.929394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314a5e1a357c4a73a33391b6f25a44c6'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:54.933583 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:54.934840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:54.936259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314a5e1a357c4a73a33391b6f25a44c6'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:54.937006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314a5e1a357c4a73a33391b6f25a44c6'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:54.942348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1195/2452] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:54.946071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314a5e1a357c4a73a33391b6f25a44c6'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:54.946756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314a5e1a357c4a73a33391b6f25a44c6'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:54.955170 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:54.965491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1258/2453] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:54 2022] DELETE /identity/v3/users/314a5e1a357c4a73a33391b6f25a44c6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:54.966929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed47a-ed82-4629-bcb5-fe8c9d39aac4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.034390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.035073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.035347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.035616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.038208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.105221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.106806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5a21-d24e-4521-83ac-799e4c010d4a service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.114862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1196/2454] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:20:55.150410 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.151815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.231266 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff203ae3-7ff7-47ce-b644-89b9dac47092 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.236216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.237623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.237907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.238180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] PATH_INFO: `/v3/projects/5d958793e0ab4e6f8d2f296dcf6186f5` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.239352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d958793e0ab4e6f8d2f296dcf6186f5)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.241618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.290673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d958793e0ab4e6f8d2f296dcf6186f5', 'request_id': 'req-24a14faa-7a39-462f-9a6d-5fa90e832998'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:55.296434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d958793e0ab4e6f8d2f296dcf6186f5', 'request_id': 'req-24a14faa-7a39-462f-9a6d-5fa90e832998'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:55.303783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d958793e0ab4e6f8d2f296dcf6186f5', 'request_id': 'req-24a14faa-7a39-462f-9a6d-5fa90e832998'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:55.314977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] The token cache is being invalidate because project 5d958793e0ab4e6f8d2f296dcf6186f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:55.315293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:55.315954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-24a14faa-7a39-462f-9a6d-5fa90e832998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:55.317533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1259/2455] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:55 2022] DELETE /identity/v3/projects/5d958793e0ab4e6f8d2f296dcf6186f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:55.323049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.323437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.323782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.341930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:55.343120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.404005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1197/2456] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:55.412988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8fda-5173-432b-85ce-9f1ab9b4fa83 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.413372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8fda-5173-432b-85ce-9f1ab9b4fa83 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.413713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8fda-5173-432b-85ce-9f1ab9b4fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.431789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-a6ce8fda-5173-432b-85ce-9f1ab9b4fa83 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:55.432988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a6ce8fda-5173-432b-85ce-9f1ab9b4fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.441858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1260/2457] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:55.447235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.456690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112b3a-cf70-4b9c-bee7-0e834dda943d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.462134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.462782 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.463058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.463327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.464217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:55.464521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.465072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.465367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.465648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.466130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.478527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1198/2458] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:55.483179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:55.483584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.484382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.496139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109927a-f208-43a4-bcdd-37e11f10b304 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.500776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.501419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.501695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.501966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.502644 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.504526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.535309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1199/2459] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:55.536294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.541559 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1261/2460] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:55.554418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.555750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.598386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3af89-ba2e-4ff1-9a3a-db6af6e897a6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.603901 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.604485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.604797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.605067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.605739 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.607638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.623673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6e424-4cdd-44a6-8495-90cbefc743d3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.627333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1200/2461] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:55.631606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.640741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52797-d814-4197-b7b6-5e07db195a27 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.645153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.645780 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.646620 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.646900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.647645 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.649239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.661852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1201/2462] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:55.663071 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.672196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119947d-6fcf-4d40-a9c3-1528db01c1ec admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.676579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.677759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.678047 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.678316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.679041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.680590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.683994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.684698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.684985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.685263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.691080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1202/2463] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:55.695719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.705251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f947-d372-46d6-916c-957df6a6f1ad admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.710475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.711345 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.711621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.711889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] PATH_INFO: `/v3/projects/08a6c5abb32e4515944252dfd6ecc133/users/097a7caa04be4afb883613f8688ef7fb/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.726330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a6c5abb32e4515944252dfd6ecc133, user_id=097a7caa04be4afb883613f8688ef7fb, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.728990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed30981-5bda-4f08-8ab2-883038809913 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.743228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1203/2464] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:55 2022] PUT /identity/v3/projects/08a6c5abb32e4515944252dfd6ecc133/users/097a7caa04be4afb883613f8688ef7fb/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:55.743837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.745652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.753976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1262/2465] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:20:55.754385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.754673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.754947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.785615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] MFA Rules not processed for user `097a7caa04be4afb883613f8688ef7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:55.787711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.880862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1204/2466] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:55.882152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:55.899961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64babc63-566d-4e52-b3b4-283b645cb1fa service swift] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:55.966194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:55.966857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.967368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.967517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.968093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:55.970007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:55.996703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1263/2467] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:56.002783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.014160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0413b-021a-4e77-8028-77d7e24622bd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.085089 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.085760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.086041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.086332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.087004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.089048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.113551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1205/2468] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:56 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:56.115626 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.126535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31f214-ab51-4cd1-a0bf-b4e93278868b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.131370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.132040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.132320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.132594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.133379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.134975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.148697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1264/2469] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:56.150075 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.160458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190285-c348-4a8f-8012-c881367645a6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.166255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.167235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.167579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.167919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] PATH_INFO: `/v3/projects/75edb856dfa042c6ba4529f90115f176/users/bc02976ea9ca4864af4448715703e5c0/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.183276 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] RBAC: Authorizing `identity:create_grant(project_id=75edb856dfa042c6ba4529f90115f176, user_id=bc02976ea9ca4864af4448715703e5c0, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.186067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.200760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1206/2470] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:56 2022] PUT /identity/v3/projects/75edb856dfa042c6ba4529f90115f176/users/bc02976ea9ca4864af4448715703e5c0/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:56.204346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.226925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023671-739d-4ab8-a911-55cccd589803 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.311054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.312722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.313218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.313686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.315014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.319731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262bc5-c970-43e5-9b86-cbf9207405a7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.334591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1265/2471] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:56.339045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.350479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647739aa-b465-4546-901b-e9a7d91274af admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.355774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.356949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.357430 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.357815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] PATH_INFO: `/v3/projects/75edb856dfa042c6ba4529f90115f176/users/bc02976ea9ca4864af4448715703e5c0/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.359988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75edb856dfa042c6ba4529f90115f176, user_id=bc02976ea9ca4864af4448715703e5c0, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.367486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.377165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1207/2472] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:56 2022] PUT /identity/v3/projects/75edb856dfa042c6ba4529f90115f176/users/bc02976ea9ca4864af4448715703e5c0/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:56.388243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.388879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.389373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.421920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] MFA Rules not processed for user `bc02976ea9ca4864af4448715703e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:56.423117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:56.507756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1266/2473] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:56.519228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.521323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:56.584326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae77aa-1c97-4a02-b863-8673c1ae97a1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.589248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.589994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.590273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.590542 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.602736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.603779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.616217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1208/2474] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:56.670992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:56.672475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:56.689192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67436-65b8-4222-9120-fa44b82e6b30 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:56.694770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:56.695597 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:56.695883 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:56.696161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:56.754506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:56.757107 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3128cf-4888-4f0f-bbb9-a07f4fe02de7 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:56.767495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1267/2475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:57.887032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:57.889023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:57.962817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df42f5-87e9-4fe3-a816-17c7f22025ac service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:57.970478 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:57.972914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:57.973403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:57.973839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] PATH_INFO: `/v3/users/d5a7722f88474e4c854863205daba9a7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:57.976565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a7722f88474e4c854863205daba9a7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:57.979103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:58.033887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a7722f88474e4c854863205daba9a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.043695 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a7722f88474e4c854863205daba9a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.050908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a7722f88474e4c854863205daba9a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.051582 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a7722f88474e4c854863205daba9a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.052209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a7722f88474e4c854863205daba9a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.070253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1209/2476] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:20:57 2022] DELETE /identity/v3/users/d5a7722f88474e4c854863205daba9a7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:58.074747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.075214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.075316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.094129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:58.095073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:58.158049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1268/2477] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:58.168468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.169892 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:58.240027 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0378-76df-4b04-9581-76647d8eb90c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:58.243912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:58.245128 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.245404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.245677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.257879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:58.259615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3e489-a56c-4e2f-8b3c-bbe25376746f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:58.269828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1210/2478] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:58.472611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.475101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:58.514343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9e24-abfb-43b6-a1eb-a9e48526da3e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:58.531076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:58.532738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.533026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.533303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] PATH_INFO: `/v3/projects/21a8caef9eca4a1c9dfcd4a5d7195443` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.536547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a8caef9eca4a1c9dfcd4a5d7195443)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:58.541226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:58.606123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a8caef9eca4a1c9dfcd4a5d7195443', 'request_id': 'req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.612683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a8caef9eca4a1c9dfcd4a5d7195443', 'request_id': 'req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.624729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a8caef9eca4a1c9dfcd4a5d7195443', 'request_id': 'req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.658754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] The token cache is being invalidate because project 21a8caef9eca4a1c9dfcd4a5d7195443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:58.660427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.661327 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f0a0d15a-6c34-4341-8d8e-db2fc8428a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:58.663689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1269/2479] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:20:58 2022] DELETE /identity/v3/projects/21a8caef9eca4a1c9dfcd4a5d7195443 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:58.669013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.669297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.669569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.705009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:58.706223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:58.787602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1211/2480] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:58.795193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.795907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.796552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.818127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:58.819895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:58.830724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1270/2481] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:58.835805 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.846863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9813e-f324-41e4-9dd0-df8765ab96f9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:58.852238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:58.852951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.853228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.853504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.854235 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:58.854534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:58.856198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:58.873651 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1212/2482] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:58.874819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.884305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238d48b-d0ab-409a-80a2-bbd70bdc0a4e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:58.896689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:58.896689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.896689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.896689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.897450 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:58.899157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:58.932841 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1271/2483] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:20:58 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:58.935179 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.947562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99fb34-c30b-499b-8952-b4fd338a6f30 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.006776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.007449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.007728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.008000 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.008772 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.010711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.034326 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1213/2484] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:20:58 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:59.035516 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:59.045659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a41-69f6-463e-a552-c26cebe7b4c7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.056458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.057537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.058020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.058299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.059030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.060693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.072473 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1272/2485] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:59.076533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:59.087762 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5bf-0053-4888-8426-988fa8b72213 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.092385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.093045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.093387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.093598 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.094336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.095915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ed6ac-acbd-4412-a495-188c4dbb2d8d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.106681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1214/2486] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:59.110973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:59.121974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe23e-24bb-4ef6-af91-ae9a1bba89fe admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.126667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.127621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.127960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.128405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] PATH_INFO: `/v3/projects/c6ebe5857f4c4cb1982b483c09080bbb/users/9562e57455e041c98b54d7f50d1b3ddf/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.143427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ebe5857f4c4cb1982b483c09080bbb, user_id=9562e57455e041c98b54d7f50d1b3ddf, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.146325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.163403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1273/2487] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:20:59 2022] PUT /identity/v3/projects/c6ebe5857f4c4cb1982b483c09080bbb/users/9562e57455e041c98b54d7f50d1b3ddf/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:59.174124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.174411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.174690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.204400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] MFA Rules not processed for user `9562e57455e041c98b54d7f50d1b3ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:59.205545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:59.271538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1215/2488] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:59.283105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:59.284904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:59.342360 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e657c-973e-4dc0-98b1-315e7483cd42 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.345943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.346591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.346872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.347142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.355840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.357290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091868-70a3-4495-9d13-5d8aec2d9569 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.366492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1274/2489] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:20:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:00.213455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:00.214919 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:00.280363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046211cd-6fce-46e0-aa1e-dd625f57dfe1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:00.285245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:00.285681 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.285958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.286224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] PATH_INFO: `/v3/users/097a7caa04be4afb883613f8688ef7fb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.288289 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097a7caa04be4afb883613f8688ef7fb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:00.290221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:00.337691 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097a7caa04be4afb883613f8688ef7fb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.346731 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097a7caa04be4afb883613f8688ef7fb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.361066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097a7caa04be4afb883613f8688ef7fb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.362506 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097a7caa04be4afb883613f8688ef7fb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.363224 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097a7caa04be4afb883613f8688ef7fb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.383325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1216/2490] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:00 2022] DELETE /identity/v3/users/097a7caa04be4afb883613f8688ef7fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:00.386901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.387377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.387474 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.406511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:00.407846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:00.483526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1275/2491] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:00.495428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:00.497962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:00.569282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a2a3-a7ae-499c-9574-fcaae1468449 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:00.572970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:00.573615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.573893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.574162 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.583236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:00.585244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:00.594815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1217/2492] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:00.952678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:00.954083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:00.967037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a625af-8104-4069-a63b-dcc41f70578e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:00.971631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:00.972487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.972803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.973105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] PATH_INFO: `/v3/projects/08a6c5abb32e4515944252dfd6ecc133` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.975246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a6c5abb32e4515944252dfd6ecc133)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:00.976839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.023132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a6c5abb32e4515944252dfd6ecc133', 'request_id': 'req-d96b1ded-a46a-4864-a09b-538bb4dee11a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.028212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a6c5abb32e4515944252dfd6ecc133', 'request_id': 'req-d96b1ded-a46a-4864-a09b-538bb4dee11a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.035438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a6c5abb32e4515944252dfd6ecc133', 'request_id': 'req-d96b1ded-a46a-4864-a09b-538bb4dee11a'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.048681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] The token cache is being invalidate because project 08a6c5abb32e4515944252dfd6ecc133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:01.048681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.048681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.049291 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1276/2493] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:00 2022] DELETE /identity/v3/projects/08a6c5abb32e4515944252dfd6ecc133 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:01.053255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.063134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdd75-8878-4e11-a042-92e47946a7c1 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.118385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.119247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.119525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.119795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] PATH_INFO: `/v3/users/bc02976ea9ca4864af4448715703e5c0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.121011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc02976ea9ca4864af4448715703e5c0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.122898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.168214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc02976ea9ca4864af4448715703e5c0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.175077 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc02976ea9ca4864af4448715703e5c0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.182466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc02976ea9ca4864af4448715703e5c0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.183103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc02976ea9ca4864af4448715703e5c0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.183690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1df0e42f-d6d6-4613-9af5-d89247132342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc02976ea9ca4864af4448715703e5c0'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.200166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1218/2494] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:01 2022] DELETE /identity/v3/users/bc02976ea9ca4864af4448715703e5c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:01.460485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.461997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.475255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b1ded-a46a-4864-a09b-538bb4dee11a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.533981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.534839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.535118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.535391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] PATH_INFO: `/v3/projects/75edb856dfa042c6ba4529f90115f176` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.537723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75edb856dfa042c6ba4529f90115f176)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.539700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.585201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75edb856dfa042c6ba4529f90115f176', 'request_id': 'req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.590350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75edb856dfa042c6ba4529f90115f176', 'request_id': 'req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.601983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75edb856dfa042c6ba4529f90115f176', 'request_id': 'req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.610579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] The token cache is being invalidate because project 75edb856dfa042c6ba4529f90115f176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:01.610873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.611512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9b8777ab-eb5f-4c28-bc83-2ffde3570ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.613075 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1277/2495] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:01 2022] DELETE /identity/v3/projects/75edb856dfa042c6ba4529f90115f176 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:01.618171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.618639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.618738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.637220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:01.637589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.697166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1219/2496] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:01.704936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.705162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.705491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.724998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:01.726188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.734102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1278/2497] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:01.738304 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.748040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7bdab-7925-4d00-92f6-76f07ccc7123 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.754832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.755791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.755791 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.756161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.756807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:01.757158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.758742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.774119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1220/2498] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:01.779273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.790712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745746-f0b3-4b0c-a60f-25ef4fd5d40f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.795720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.796373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.796678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.796980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.797743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.799947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.828129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1279/2499] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:01 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:01.832167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.843016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd104a-b07f-416c-a047-b2a9e2bb90f2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.900072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.900783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.901068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.901343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.902045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.903967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.927729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1221/2500] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:01 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:01.931801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.942423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986eff-f546-408e-b27d-2ae35a59e4d2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.947835 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.948490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.948810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.949086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.949804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.951481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.962846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1280/2501] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:01.967035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.977033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c5d5-35e8-47cc-9d8e-c11c4b13355a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.981894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.982589 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.982863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.983247 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.983999 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.985596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864b161-95b3-4160-818a-ef6ea74f39fb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.995783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1222/2502] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:01.999973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.010665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7bc0e-4d98-4717-84e3-778d9dfcb924 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.015297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.016164 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.016442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.016743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] PATH_INFO: `/v3/projects/3b5fabc58e874ff4af2f4c949993cfc4/users/20fe7a96e8654357a6ffbcfce860a746/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.031486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5fabc58e874ff4af2f4c949993cfc4, user_id=20fe7a96e8654357a6ffbcfce860a746, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.034170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.046522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1281/2503] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:01 2022] PUT /identity/v3/projects/3b5fabc58e874ff4af2f4c949993cfc4/users/20fe7a96e8654357a6ffbcfce860a746/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:02.057804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.058091 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.058364 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.085108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] MFA Rules not processed for user `20fe7a96e8654357a6ffbcfce860a746`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:02.086287 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.148050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1223/2504] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:02.152631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.211366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228a23-ead2-43f2-a284-08daa6d816d7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.216027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.216501 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.216814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.217092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.217764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.219641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.244250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1282/2505] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:02 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:02.248400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.259189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3a84-a342-4ec2-86c0-b396a58039d8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.312667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.313335 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.313624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.313898 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.314566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.316457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.336831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1224/2506] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:02 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:02.340202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.351270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c108-d92c-4175-abd3-775b419cebe8 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.355895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.356541 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.356852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.357123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.357833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.359407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.371198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1283/2507] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:02.375366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.386159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f891e-327b-43a9-b3ea-27f84af2a9e6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.390950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.391821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.392119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.392410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] PATH_INFO: `/v3/projects/b4b2b82875234348b784a0c155f39efe/users/897c26206c6c459d9178435b8ee87f42/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.407499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b2b82875234348b784a0c155f39efe, user_id=897c26206c6c459d9178435b8ee87f42, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.410169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.422351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1225/2508] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:02 2022] PUT /identity/v3/projects/b4b2b82875234348b784a0c155f39efe/users/897c26206c6c459d9178435b8ee87f42/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:02.426342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.437270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45732-87d7-4b5b-a3e0-fbf6e74068ce admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.499437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.500071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.500296 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.500567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.501319 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.502926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a656-3e4b-4ee3-923b-4237785d2202 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.513324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1284/2509] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:02.517474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.532340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de75d-7479-42f0-a602-38687029cb60 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.537076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.537945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.538252 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.538744 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] PATH_INFO: `/v3/projects/b4b2b82875234348b784a0c155f39efe/users/897c26206c6c459d9178435b8ee87f42/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.540861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b2b82875234348b784a0c155f39efe, user_id=897c26206c6c459d9178435b8ee87f42, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.543508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.554140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1226/2510] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:02 2022] PUT /identity/v3/projects/b4b2b82875234348b784a0c155f39efe/users/897c26206c6c459d9178435b8ee87f42/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:02.564071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.564365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.564642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.591498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] MFA Rules not processed for user `897c26206c6c459d9178435b8ee87f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:02.592722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.657680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1285/2511] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:02.669255 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.670925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.726579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffe07-4a41-4779-9fcd-48e127974974 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.730152 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.730781 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.731058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.731329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.739888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.741328 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6be564-8363-4f7b-a932-d1c432882690 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.750471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1227/2512] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:02.814758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.875432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257995-5cbd-4a9b-8a91-676a2cd4687a None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.879956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.880873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.881170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.881423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] PATH_INFO: `/v3/users/20fe7a96e8654357a6ffbcfce860a746` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.882624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fe7a96e8654357a6ffbcfce860a746)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.884533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.930150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fe7a96e8654357a6ffbcfce860a746'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.937859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fe7a96e8654357a6ffbcfce860a746'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.938901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fe7a96e8654357a6ffbcfce860a746'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.947463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fe7a96e8654357a6ffbcfce860a746'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.949849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fe7a96e8654357a6ffbcfce860a746'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.967324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1286/2513] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:02 2022] DELETE /identity/v3/users/20fe7a96e8654357a6ffbcfce860a746 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:02.971954 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.972258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.972532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.990605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:02.992097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.053378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1228/2514] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:03.062984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.064549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.120855 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b113c-c038-4ed9-8bd4-5bd155f0aa43 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.124396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.125084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.125361 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.125628 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.135015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.136415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.145567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1287/2515] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:03.402489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.403984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.417600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14122-94b6-44cc-b258-ae519dd9fc39 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.422108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.423057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.423338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.423611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] PATH_INFO: `/v3/projects/3b5fabc58e874ff4af2f4c949993cfc4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.425465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5fabc58e874ff4af2f4c949993cfc4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.427565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.473125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5fabc58e874ff4af2f4c949993cfc4', 'request_id': 'req-2327babf-7201-4e0e-9b6c-110b9d94f81b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.478601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5fabc58e874ff4af2f4c949993cfc4', 'request_id': 'req-2327babf-7201-4e0e-9b6c-110b9d94f81b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.485796 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5fabc58e874ff4af2f4c949993cfc4', 'request_id': 'req-2327babf-7201-4e0e-9b6c-110b9d94f81b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.497572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] The token cache is being invalidate because project 3b5fabc58e874ff4af2f4c949993cfc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:03.497850 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.498474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.500063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1229/2516] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:03 2022] DELETE /identity/v3/projects/3b5fabc58e874ff4af2f4c949993cfc4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:03.504034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.514010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73c53-ad65-442a-9201-2338838efd11 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.568244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.569060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.569334 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.569600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] PATH_INFO: `/v3/users/897c26206c6c459d9178435b8ee87f42` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.570875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c26206c6c459d9178435b8ee87f42)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.572800 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.615726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c26206c6c459d9178435b8ee87f42'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.622182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c26206c6c459d9178435b8ee87f42'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.622830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c26206c6c459d9178435b8ee87f42'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.630840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c26206c6c459d9178435b8ee87f42'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.631527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-f65d0410-179d-4988-988b-f5d927e66822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c26206c6c459d9178435b8ee87f42'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.648367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1288/2517] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:03 2022] DELETE /identity/v3/users/897c26206c6c459d9178435b8ee87f42 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:03.952242 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.953818 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.970093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327babf-7201-4e0e-9b6c-110b9d94f81b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.062296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.063185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.063664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.063950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] PATH_INFO: `/v3/projects/b4b2b82875234348b784a0c155f39efe` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.065245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b2b82875234348b784a0c155f39efe)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.070057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.127989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b2b82875234348b784a0c155f39efe', 'request_id': 'req-234f0780-34df-441f-9f03-e9bc1f50ffaa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:04.134456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b2b82875234348b784a0c155f39efe', 'request_id': 'req-234f0780-34df-441f-9f03-e9bc1f50ffaa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:04.143724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b2b82875234348b784a0c155f39efe', 'request_id': 'req-234f0780-34df-441f-9f03-e9bc1f50ffaa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:04.158821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] The token cache is being invalidate because project b4b2b82875234348b784a0c155f39efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:04.159396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:04.160978 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-234f0780-34df-441f-9f03-e9bc1f50ffaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:04.164416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1230/2518] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:03 2022] DELETE /identity/v3/projects/b4b2b82875234348b784a0c155f39efe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:04.171556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.178269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.178269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.222137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:04.223404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:04.308789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1289/2519] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:04.313985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.314496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.316031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.338373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:04.339591 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:04.347666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1231/2520] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:04.352244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.362300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c0f45-6999-4c8e-a0e6-2e32f3564cd8 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.367583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.368310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.368631 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.368966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.369725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:04.370522 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.371630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.387506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1290/2521] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:04.388613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.398663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfceb-402a-47f9-84d1-7b3c33f8ae81 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.403210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.403856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.404138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.404401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.405385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.407248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.435712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1232/2522] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:04.437141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.448407 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523271a-e5b6-4088-85ca-aca9d5fb293e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.506088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.506840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.507038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.507423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.508112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.510379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.534225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1291/2523] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:04.535460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.546033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a032b7-02cd-4c2a-b461-f289aa27cf57 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.550592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.551241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.551517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.551786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.553259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.554838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.569069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1233/2524] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:04.570394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.580596 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f4b9-ef69-4cba-ba54-7c34c08108e2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.585357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.586009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.586293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.586593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.587341 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.588977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22ceda-1fba-4fc2-94b4-41eef78be6ea admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.601020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1292/2525] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:04.605410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.616733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab70eaa-9e8e-45ae-9796-93d889053c8e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.622016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.623093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.623472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.623836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] PATH_INFO: `/v3/projects/52e2eeba033c4830b2a6952baaada9f4/users/b552bc389961437eaf88d9465f9f8e31/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.640457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e2eeba033c4830b2a6952baaada9f4, user_id=b552bc389961437eaf88d9465f9f8e31, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.643378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.658439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1234/2526] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:04 2022] PUT /identity/v3/projects/52e2eeba033c4830b2a6952baaada9f4/users/b552bc389961437eaf88d9465f9f8e31/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:04.670304 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.670588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.670860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.709487 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] MFA Rules not processed for user `b552bc389961437eaf88d9465f9f8e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:04.711256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:04.830686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1293/2527] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:04.836437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.914490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180a40-b06c-4b3e-b5e4-a84f2db6cf73 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.919996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.920611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.920869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.921520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.921884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.933924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.985867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1235/2528] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:04.990382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.033886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bba1cf-41c6-4b47-a920-61cbe3cdec39 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.081288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.083036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:05.129150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.130956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.133737 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.134881 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.138690 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.141423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.171094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1294/2529] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:05.175952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.193875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b5a4-03a1-417b-99d3-52dd18588fa7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.197108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d925f2-36e1-4b09-8e19-c9b86f82f7ab admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.199595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.200892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.201313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.201685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.202568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.202885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.203692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.204134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.204768 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.205276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.207189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:05.220483 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.225667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1295/2530] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:05.226801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.239454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405580-731c-4feb-a872-8a4378fd8e74 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.240230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.247072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.249743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.251433 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.251822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] PATH_INFO: `/v3/projects/78498cdbe17e48e6aa05a0db061cca38/users/ed8b507677a34a87aaf9984034ffb069/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.273774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1236/2531] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:05.279153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78498cdbe17e48e6aa05a0db061cca38, user_id=ed8b507677a34a87aaf9984034ffb069, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.282810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.310808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1296/2532] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:05 2022] PUT /identity/v3/projects/78498cdbe17e48e6aa05a0db061cca38/users/ed8b507677a34a87aaf9984034ffb069/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:05.314958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.325902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2735b8-5c4a-47ce-a655-2fb1937bd3ef service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.403664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.404477 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.405203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.405487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.407160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.408646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa26c-7299-4d6a-adda-9c7ff3d07156 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.419931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1237/2533] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:05.424046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.439904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9629bc3-b72d-42b2-abdb-d667d34b3bb7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.446205 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.447345 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.447811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.448235 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] PATH_INFO: `/v3/projects/78498cdbe17e48e6aa05a0db061cca38/users/ed8b507677a34a87aaf9984034ffb069/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.450685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78498cdbe17e48e6aa05a0db061cca38, user_id=ed8b507677a34a87aaf9984034ffb069, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.453795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.471253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1297/2534] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:05 2022] PUT /identity/v3/projects/78498cdbe17e48e6aa05a0db061cca38/users/ed8b507677a34a87aaf9984034ffb069/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:05.481911 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.482236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.482515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.534263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] MFA Rules not processed for user `ed8b507677a34a87aaf9984034ffb069`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:05.536122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:05.610196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1238/2535] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:05.621504 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.623227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:05.683856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3a2-c302-4374-93de-00edde2dd181 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.687767 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.688447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.688760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.689036 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.700032 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.701535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.713037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1298/2536] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:05.822359 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:05.835559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220573-8453-40f2-9b10-1cc33ffb4591 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:05.839553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:05.840297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:05.840675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:05.841039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:05.909753 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:05.911490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:05.928844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1239/2537] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:09.964765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:09.966419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:10.032989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e3f5-7568-4875-aa0b-0fd2c976c302 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.038260 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.039129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.039412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.039688 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] PATH_INFO: `/v3/users/775d3d61ab8d42c3a528028592ad71f8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.040895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775d3d61ab8d42c3a528028592ad71f8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.042803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.089288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775d3d61ab8d42c3a528028592ad71f8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.095644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775d3d61ab8d42c3a528028592ad71f8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.096302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775d3d61ab8d42c3a528028592ad71f8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.105785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775d3d61ab8d42c3a528028592ad71f8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.106467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcb3c6ad-47a7-4c43-9053-42a4e39399c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775d3d61ab8d42c3a528028592ad71f8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.124307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1299/2538] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:09 2022] DELETE /identity/v3/users/775d3d61ab8d42c3a528028592ad71f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:10.293894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.314475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc9e12-66ed-4ca1-824e-6af511c4be07 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.374949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.375808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.376156 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.376338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] PATH_INFO: `/v3/projects/5a2376b2c653467b885e8f3deb5018e7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.377540 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2376b2c653467b885e8f3deb5018e7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.379419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.427725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2376b2c653467b885e8f3deb5018e7', 'request_id': 'req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.433072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2376b2c653467b885e8f3deb5018e7', 'request_id': 'req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.440777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2376b2c653467b885e8f3deb5018e7', 'request_id': 'req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.452086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] The token cache is being invalidate because project 5a2376b2c653467b885e8f3deb5018e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:10.452496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.453151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ca16ef98-7d44-4b4e-89aa-6d019a7326b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:10.454660 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1240/2539] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:10 2022] DELETE /identity/v3/projects/5a2376b2c653467b885e8f3deb5018e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:10.461112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.461394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.461689 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.479610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:10.480867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:10.548083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1300/2540] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:10.557037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.557323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.557594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.576196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:10.577428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:10.585354 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1241/2541] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:10.589519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.598977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b29c2-d623-4175-a9d2-b13c1a6314a1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.603538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.604194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.604482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.604788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.605521 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:10.605862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.607464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.619535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1301/2542] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:10.623670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.633470 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcc892-092d-43da-b8ee-4ee9564423ef None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.638150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.638810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.639088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.639360 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.640061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.641984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.671463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1242/2543] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:10 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:10.672640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.683301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5cb9-9852-401c-b362-d6fbb7538c1d admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.742927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.743589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.743867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.744139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.744920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.747163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.770721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1302/2544] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:10 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:10.772083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.785206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779e49-857b-4a10-bbb5-e591a2976b42 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.790310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.790907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.791190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.791465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.792207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.793844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.805741 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1243/2545] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:10.809908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.821593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af33c0-b584-4d99-877b-c964af8ac14f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.826934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.827704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.827989 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.828265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.829027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.830648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d3516-2a8c-4e38-9f1f-f6fc59b63c45 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.843543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1303/2546] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:10.847521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:10.860105 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ae15-f216-4937-b380-9bfbe34d6327 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:10.867205 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:10.868250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.868535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.868852 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] PATH_INFO: `/v3/projects/0ead0326f2e64c9ebde184a40de56848/users/6363d9ffba6c4f5a83311bb96e0f83ad/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.910145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ead0326f2e64c9ebde184a40de56848, user_id=6363d9ffba6c4f5a83311bb96e0f83ad, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:10.916355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:10.941986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1244/2547] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:10 2022] PUT /identity/v3/projects/0ead0326f2e64c9ebde184a40de56848/users/6363d9ffba6c4f5a83311bb96e0f83ad/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:10.958074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:10.959103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:10.959873 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:10.997703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] MFA Rules not processed for user `6363d9ffba6c4f5a83311bb96e0f83ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:10.999810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.059790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.061889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.117568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1304/2548] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:11.120702 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.152439 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a042d-aef4-4625-9d5a-3f6fcd2f964e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.157714 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.159933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.160221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.160502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] PATH_INFO: `/v3/users/b552bc389961437eaf88d9465f9f8e31` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.162666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b552bc389961437eaf88d9465f9f8e31)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.165039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.223375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223e91f-8bca-43a7-82fb-f3e55f1ad1c4 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.231953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.233324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.233646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.234282 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.235343 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.235584 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b552bc389961437eaf88d9465f9f8e31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:11.237974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.246643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b552bc389961437eaf88d9465f9f8e31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:11.256902 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b552bc389961437eaf88d9465f9f8e31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:11.257564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b552bc389961437eaf88d9465f9f8e31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:11.258288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e5c3e5d3-f0ef-4cc1-80c9-ebe93e4e5920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b552bc389961437eaf88d9465f9f8e31'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:11.271926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1305/2549] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:11.277599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.279255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.288580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1245/2550] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:11 2022] DELETE /identity/v3/users/b552bc389961437eaf88d9465f9f8e31 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:11.293085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.294868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.294868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.311973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:11.313398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.353889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673e00-ef84-498b-9d2b-dcc8860d9433 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.386446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1246/2551] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:11.398603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.401615 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.426367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.427061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.427935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.427935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.428642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.430743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.460056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1306/2552] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:11.464455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.475136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8646f9-2557-476c-990d-f899120f6554 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.478649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc81f-b43c-4049-a15d-750a7c3af67b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.480538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.481231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.481517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.481794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.482510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.482629 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.483250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.483555 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.483827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.484095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.493802 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.495450 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.498604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1307/2553] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:11.503488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.510172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1247/2554] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:11.514269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417755-be33-4bd1-81e8-3660dae58453 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.518888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.519774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.520054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.520325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] PATH_INFO: `/v3/projects/5240ef3721f2426caf70ce78409c36a5/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.540917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5240ef3721f2426caf70ce78409c36a5, user_id=ec2cdcdbd86e438a8ff4be5a6e5ab86c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.542462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.564741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1308/2555] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:11 2022] PUT /identity/v3/projects/5240ef3721f2426caf70ce78409c36a5/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:11.568210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.578087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7625d-5743-4772-85de-2dea426d90df service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.645672 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.647231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.647668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.648114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.649452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.651146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c299ff3-74b5-4842-abbd-86f2aaed8231 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.673774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1248/2556] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:11.675415 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.689685 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89828b-1688-424a-87ee-bd9515f3cdc2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.697221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.698214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.698500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.698781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] PATH_INFO: `/v3/projects/5240ef3721f2426caf70ce78409c36a5/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.701357 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5240ef3721f2426caf70ce78409c36a5, user_id=ec2cdcdbd86e438a8ff4be5a6e5ab86c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.705893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.722230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1309/2557] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:11 2022] PUT /identity/v3/projects/5240ef3721f2426caf70ce78409c36a5/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:11.735037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.735593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.736082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.773976 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] MFA Rules not processed for user `ec2cdcdbd86e438a8ff4be5a6e5ab86c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:11.775807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.870542 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.873138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.876274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1249/2558] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:11.892250 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.894594 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.965829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b12d-0682-4197-82aa-9a3ae027d927 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.970520 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.971389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.971672 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.972188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] PATH_INFO: `/v3/projects/52e2eeba033c4830b2a6952baaada9f4` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.973815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e2eeba033c4830b2a6952baaada9f4)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.975932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:11.991566 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309581-b5b2-481c-acbc-5bf498caea45 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.995564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.996340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.996702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.997034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.009188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.010657 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.023016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1250/2559] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:12.031169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e2eeba033c4830b2a6952baaada9f4', 'request_id': 'req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.039787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e2eeba033c4830b2a6952baaada9f4', 'request_id': 'req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.054536 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.061549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e2eeba033c4830b2a6952baaada9f4', 'request_id': 'req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.073752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660bf35-7488-435b-9905-9fdefd69af41 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.078087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] The token cache is being invalidate because project 52e2eeba033c4830b2a6952baaada9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:12.079180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.080084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.082320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1310/2560] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:11 2022] DELETE /identity/v3/projects/52e2eeba033c4830b2a6952baaada9f4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:12.086640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.088143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.145836 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.147452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.148055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.148414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] PATH_INFO: `/v3/users/6363d9ffba6c4f5a83311bb96e0f83ad` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.149848 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6363d9ffba6c4f5a83311bb96e0f83ad)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.151882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.166770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba281-8b95-45d0-a8e8-cbbdfd3b9a48 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.171518 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.172389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.172693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.172975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] PATH_INFO: `/v3/users/ed8b507677a34a87aaf9984034ffb069` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.174180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8b507677a34a87aaf9984034ffb069)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.176119 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.199504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6363d9ffba6c4f5a83311bb96e0f83ad'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.207613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6363d9ffba6c4f5a83311bb96e0f83ad'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.214905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6363d9ffba6c4f5a83311bb96e0f83ad'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.215544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6363d9ffba6c4f5a83311bb96e0f83ad'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.216151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddd7b425-67ca-46cc-9a5d-78c611eb920a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6363d9ffba6c4f5a83311bb96e0f83ad'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.223600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8b507677a34a87aaf9984034ffb069'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.233573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1251/2561] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:12 2022] DELETE /identity/v3/users/6363d9ffba6c4f5a83311bb96e0f83ad => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:12.235876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8b507677a34a87aaf9984034ffb069'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.236622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8b507677a34a87aaf9984034ffb069'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.237867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.238192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.238432 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.245010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8b507677a34a87aaf9984034ffb069'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.245829 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8b507677a34a87aaf9984034ffb069'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.257149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:12.258424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.263718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1311/2562] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:12 2022] DELETE /identity/v3/users/ed8b507677a34a87aaf9984034ffb069 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:12.321400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1252/2563] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:12.333768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.334886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.406416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.410436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf57a6-536e-4815-aa6b-bc1737ca68d8 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.417439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.418561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.418848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.419123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.476534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df392b-e866-4619-a44f-e3c12c625e2c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.481832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.483934 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.484281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.484559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.486595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.493446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.495239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.503994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.506169 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5435d4-69a7-4bb3-a22e-658dc5fbb946 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.510033 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1312/2564] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:12.516903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1253/2565] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:12.730193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.731858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.744378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44884bb4-4aba-41fc-bfa8-13ad94a8c52e service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.749524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.750427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.750733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.751013 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] PATH_INFO: `/v3/projects/78498cdbe17e48e6aa05a0db061cca38` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.753058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78498cdbe17e48e6aa05a0db061cca38)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.755708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.810241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78498cdbe17e48e6aa05a0db061cca38', 'request_id': 'req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.815917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78498cdbe17e48e6aa05a0db061cca38', 'request_id': 'req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.823250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78498cdbe17e48e6aa05a0db061cca38', 'request_id': 'req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.837696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] The token cache is being invalidate because project 78498cdbe17e48e6aa05a0db061cca38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:12.837986 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.838674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d0c851ac-1e0e-4fb5-8a7d-1479c11cc901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:12.843663 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1313/2566] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:12 2022] DELETE /identity/v3/projects/78498cdbe17e48e6aa05a0db061cca38 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:12.846149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.846967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.847480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.870181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:12.871655 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.944492 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1254/2567] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:12.953682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.953893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.954271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.977490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:12.978759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:12.987432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1314/2568] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:12.992876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.004523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d5e0b-bd4b-4b93-bdf2-39c75da4de57 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.011346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.012271 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.012638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.014025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.014876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:13.015263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.017055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.031411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1255/2569] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:13.036423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.048799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8489-87d3-43bc-a9bd-63b1d59b672e None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.056200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.056934 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.057215 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.057488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.058204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.060139 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.091802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1315/2570] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:13 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:13.096601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.109697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a88c-9f23-4db9-bfb7-bbd68c50b3e8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.181719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.183196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.184140 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.184588 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.186125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.188786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.214187 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1256/2571] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:13 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:13.218987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.229660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b92f69-c350-447b-9bb6-22dd0ac99e8f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.234503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.235263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.235612 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.235949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.236768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.238703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.249761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1316/2572] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:13.253823 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.264743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f82c-4312-4fa1-b729-9d9c94d14920 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.269941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.270710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.271052 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.272180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.273165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.274819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2b100-7b7e-42bf-afd6-bed85f8387df admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.289400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1257/2573] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:13.293425 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.304938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb0756-d4ae-4d75-a66e-8cc044ef8edc admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.310912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.311889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.312271 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.312703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] PATH_INFO: `/v3/projects/d537921027294716af9874389628492c/users/4609c85923df4a18a09dfad8759d06ca/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.328489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d537921027294716af9874389628492c, user_id=4609c85923df4a18a09dfad8759d06ca, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.331331 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.347635 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1317/2574] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:13 2022] PUT /identity/v3/projects/d537921027294716af9874389628492c/users/4609c85923df4a18a09dfad8759d06ca/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:13.353639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.354145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.354260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.371908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:13.373142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:13.441291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1258/2575] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:13.445984 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.447693 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:13.460798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84df8-b653-4c18-99f9-9c0c1ed7ed5c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.461374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.463578 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:13.466750 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.467722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.468087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.468470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] PATH_INFO: `/v3/projects/0ead0326f2e64c9ebde184a40de56848` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.469853 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ead0326f2e64c9ebde184a40de56848)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.472029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.540434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5969dd-b926-4bac-8007-7e1f580213e8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.546010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ead0326f2e64c9ebde184a40de56848', 'request_id': 'req-468ac989-a29f-432d-add8-a5b88826c6e9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.553368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ead0326f2e64c9ebde184a40de56848', 'request_id': 'req-468ac989-a29f-432d-add8-a5b88826c6e9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.564594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ead0326f2e64c9ebde184a40de56848', 'request_id': 'req-468ac989-a29f-432d-add8-a5b88826c6e9'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.581708 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] The token cache is being invalidate because project 0ead0326f2e64c9ebde184a40de56848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:13.581997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.583553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.585590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1318/2576] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:13 2022] DELETE /identity/v3/projects/0ead0326f2e64c9ebde184a40de56848 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:13.590067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:13.591736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:13.606646 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.607914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.608429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.609076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.612010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:13.677944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ac989-a29f-432d-add8-a5b88826c6e9 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:13.683712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:13.684687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:13.685101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:13.685468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] PATH_INFO: `/v3/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:13.686778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2cdcdbd86e438a8ff4be5a6e5ab86c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.688837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.698440 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:13.699997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:13.710635 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1259/2577] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:13.743427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2cdcdbd86e438a8ff4be5a6e5ab86c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.752168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2cdcdbd86e438a8ff4be5a6e5ab86c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.752970 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2cdcdbd86e438a8ff4be5a6e5ab86c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.761827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2cdcdbd86e438a8ff4be5a6e5ab86c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.762978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-225f2a58-dace-49ce-8ba7-291f92be7396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2cdcdbd86e438a8ff4be5a6e5ab86c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:13.787025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1319/2578] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:13 2022] DELETE /identity/v3/users/ec2cdcdbd86e438a8ff4be5a6e5ab86c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:14.415330 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:14.426353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacb2b-14f9-4eea-9b7f-3cdb1230fd9f service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:14.523404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:14.524534 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.524878 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.525833 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] PATH_INFO: `/v3/projects/5240ef3721f2426caf70ce78409c36a5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.527108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5240ef3721f2426caf70ce78409c36a5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:14.529378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:14.558086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.559220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.559698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.592878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] MFA Rules not processed for user `4609c85923df4a18a09dfad8759d06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:14.594432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:14.612407 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5240ef3721f2426caf70ce78409c36a5', 'request_id': 'req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:14.627192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5240ef3721f2426caf70ce78409c36a5', 'request_id': 'req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:14.641458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5240ef3721f2426caf70ce78409c36a5', 'request_id': 'req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:14.656092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] The token cache is being invalidate because project 5240ef3721f2426caf70ce78409c36a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:14.656468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:14.657587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2f9091ea-a89a-4f0b-a8e8-05a0c3f21f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:14.663578 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1260/2579] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:14 2022] DELETE /identity/v3/projects/5240ef3721f2426caf70ce78409c36a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:14.665729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267a38-b47c-4276-a598-d478cbca5fef None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.666087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267a38-b47c-4276-a598-d478cbca5fef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.666429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267a38-b47c-4276-a598-d478cbca5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.687142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1320/2580] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:14.687738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f7267a38-b47c-4276-a598-d478cbca5fef None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:14.689070 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f7267a38-b47c-4276-a598-d478cbca5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:14.695383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:14.698423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:14.772990 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1261/2581] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:14.781099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.781390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.781668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.797152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b69d2-624d-4e3a-b696-f417602b8cb7 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:14.800975 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:14.802243 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:14.802415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:14.803146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.803562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.803951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.804768 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:14.811223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1262/2582] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:14.815308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:14.817608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:14.831748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e300-3ff8-4d27-8a33-cf8c55f43aba None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:14.838331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:14.839244 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.839914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.840198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.843938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:14.844370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:14.846870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:14.855338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1321/2583] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:14.861019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:14.867331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1263/2584] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:21:14.875043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:14.885895 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dad6e-423a-470b-9d5f-804771fe1f54 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:14.948462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d463c-6cb4-46de-8b17-ae9dc81f6f92 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:14.954100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:14.954968 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.955330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.955679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.956485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:14.956667 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:14.957314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:14.957600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:14.957871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:14.958617 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:14.959608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:14.961517 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:14.987856 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1322/2585] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:14.992311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.001687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1264/2586] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:15.002690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.004369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572425bb-ec31-48ab-a777-27a5e2329280 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.096877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.097667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.098047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.098418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.099446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.101888 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.115745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1323/2587] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:15.119406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.134059 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789a248-081a-4a34-9d68-e3a06ab4b9ce admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.135500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f170d-8f9b-40cd-a0c2-d4264ed52958 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.142338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.143132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.143446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.144552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.145854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.148383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.149611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.150638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.151018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.151386 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] PATH_INFO: `/v3/projects/1071d4df1185488d9b7680af88e7dbb3/users/e377d80adb34491c9ffa32312de44490/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.189699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1265/2588] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:15 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:15.197754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1071d4df1185488d9b7680af88e7dbb3, user_id=e377d80adb34491c9ffa32312de44490, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.197987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.201325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.211654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cacd9a-13fe-4adc-a801-67f101f256d2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.221810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.222509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.222790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.223065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.223795 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.225658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.235262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1324/2589] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:15 2022] PUT /identity/v3/projects/1071d4df1185488d9b7680af88e7dbb3/users/e377d80adb34491c9ffa32312de44490/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:15.235462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.241198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1266/2590] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:15.245438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.256266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11ff5-3936-4616-8cb0-a4cc22f33c82 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.327327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.328463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.329084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.331109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.332979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.336820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.344421 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c309-e3bd-411e-b3cf-37eb2b323325 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.353284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.354014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.354301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.354579 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.361126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.362101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1267/2591] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:15.362784 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.366546 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.387356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1325/2592] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:15.395862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.397035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231855-1c38-41b3-8d5e-f8f32b157300 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.412305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.414097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.415166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.415929 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] PATH_INFO: `/v3/projects/b98b8e81b59f44d5a8225bfbbd46c9b8/users/ef1b82099df54d148c0e876e9489c376/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.418918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34edb1-a3e9-4283-b533-736875943306 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.435682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.436766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.437154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.437525 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] PATH_INFO: `/v3/projects/1071d4df1185488d9b7680af88e7dbb3/users/e377d80adb34491c9ffa32312de44490/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.441370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1071d4df1185488d9b7680af88e7dbb3, user_id=e377d80adb34491c9ffa32312de44490, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.447163 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a40d-643f-4144-a5a1-0117cf2c5740 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.451202 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b8e81b59f44d5a8225bfbbd46c9b8, user_id=ef1b82099df54d148c0e876e9489c376, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.455036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.467775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1326/2593] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:15 2022] PUT /identity/v3/projects/1071d4df1185488d9b7680af88e7dbb3/users/e377d80adb34491c9ffa32312de44490/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:15.488277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1268/2594] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:15 2022] PUT /identity/v3/projects/b98b8e81b59f44d5a8225bfbbd46c9b8/users/ef1b82099df54d148c0e876e9489c376/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:15.491819 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.492225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.492619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.542551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] MFA Rules not processed for user `ef1b82099df54d148c0e876e9489c376`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:15.543774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:15.664943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1327/2595] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:15.665567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.762661 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac56e-22d4-4cc2-b178-26fa67d3ccca admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.769341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.770401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.771759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.772377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.773726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.777606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.836348 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1269/2596] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:15 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:15.840365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.864309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbbcfc-8160-4a3b-b4d3-7df65bc59ad6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.983832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.984535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.984848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.985132 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.985895 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.987837 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.036234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1328/2597] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:15 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:16.040120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.060373 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83e310-7153-449b-9817-c23b3c3efec2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.082259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.083005 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.083282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.084605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.085454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.088167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.111054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1270/2598] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:16.113879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.132924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288784-1403-443f-83c2-e81102f06b96 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.145512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.146465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.146747 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.147049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] PATH_INFO: `/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4/users/6cd5675970074668885897e5ca8c6b1e/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.163946 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ec1e62bb64fc792d7043aae8d65f4, user_id=6cd5675970074668885897e5ca8c6b1e, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.167082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.191184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1329/2599] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:16 2022] PUT /identity/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4/users/6cd5675970074668885897e5ca8c6b1e/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:16.195486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.217191 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71832e15-9e3e-408a-95c0-488665fc17bd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.284213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.287572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.297061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.297908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.298260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.298601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.299574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.301130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.314197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1271/2600] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:16.318434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.330458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc805-6cc2-4a0e-85c2-047534777dcc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.338131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.339421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.340226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.340986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] PATH_INFO: `/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4/users/6cd5675970074668885897e5ca8c6b1e/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.343378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ec1e62bb64fc792d7043aae8d65f4, user_id=6cd5675970074668885897e5ca8c6b1e, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.346545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a841ef-eda2-4c8a-b9f5-b9a14b923dab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.358707 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1272/2601] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:16 2022] PUT /identity/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4/users/6cd5675970074668885897e5ca8c6b1e/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:16.361861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3432-b83f-45db-b395-28b8f597e61a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.371200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.371200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.371507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.400296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] MFA Rules not processed for user `6cd5675970074668885897e5ca8c6b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:16.401581 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.422932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.423949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.424326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.424720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] PATH_INFO: `/v3/users/9562e57455e041c98b54d7f50d1b3ddf` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.426015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9562e57455e041c98b54d7f50d1b3ddf)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.428942 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.513832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1273/2602] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:16.526570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9562e57455e041c98b54d7f50d1b3ddf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:16.534662 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.540311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.544393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9562e57455e041c98b54d7f50d1b3ddf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:16.545887 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9562e57455e041c98b54d7f50d1b3ddf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:16.564543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9562e57455e041c98b54d7f50d1b3ddf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:16.565213 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d1f61565-72e0-4ad8-9ba5-325f507c078f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9562e57455e041c98b54d7f50d1b3ddf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:16.601812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1330/2603] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:16 2022] DELETE /identity/v3/users/9562e57455e041c98b54d7f50d1b3ddf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:16.606024 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.606430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.606825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.649858 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:16.652136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.684463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af16a-e45c-4720-9c43-60b6a67e6927 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.743350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1331/2604] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:16.756937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.757696 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.758157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.758599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.760924 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.762116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:16.763519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:16.828830 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca845365-a317-4969-a2d4-2d9d3fff979b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:16.835524 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:16.836196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.836480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.836792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.848058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.850812 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863ae13-52a1-424e-b036-ceaffa57560e service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.863250 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1332/2605] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:16.876979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:16.878927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:16.896903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1274/2606] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:16.915342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd25a-1983-4547-a229-8a00e473dbf3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:16.915636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd25a-1983-4547-a229-8a00e473dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:16.915919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd25a-1983-4547-a229-8a00e473dbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:16.967129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c02bd25a-1983-4547-a229-8a00e473dbf3 None None] MFA Rules not processed for user `e377d80adb34491c9ffa32312de44490`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:16.968722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c02bd25a-1983-4547-a229-8a00e473dbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.143418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1333/2607] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:17.159054 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:17.162869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.182842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfea2a-8469-45f5-ad4e-be2fa6180b27 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:17.191218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:17.192099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:17.192374 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:17.192663 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:17.196889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.277994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:17.278457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:17.278838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:17.332404 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:17.336153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.374965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:17.378021 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:17.420698 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1275/2608] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:17.475160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:17.480732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.498757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1334/2609] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:17.516563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb841d0-80f2-495f-869b-f388e397e76b service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:17.518581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:17.520681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.534659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:17.538055 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:17.540586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:17.540973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] PATH_INFO: `/v3/projects/c6ebe5857f4c4cb1982b483c09080bbb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:17.543058 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ebe5857f4c4cb1982b483c09080bbb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:17.549181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:17.659385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ebe5857f4c4cb1982b483c09080bbb', 'request_id': 'req-ddcbc784-c32f-46d4-9561-5230aa444231'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:17.668527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ebe5857f4c4cb1982b483c09080bbb', 'request_id': 'req-ddcbc784-c32f-46d4-9561-5230aa444231'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:17.682632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ebe5857f4c4cb1982b483c09080bbb', 'request_id': 'req-ddcbc784-c32f-46d4-9561-5230aa444231'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:17.690821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e6fe-eb49-4393-8fcd-82683ae79489 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:17.715673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] The token cache is being invalidate because project c6ebe5857f4c4cb1982b483c09080bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:17.716081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:17.717163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:17.718844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1276/2610] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:17 2022] DELETE /identity/v3/projects/c6ebe5857f4c4cb1982b483c09080bbb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:17.719616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:17.721239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.836268 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:17.837675 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:17.838121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:17.838557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:17.841001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:17.882992 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc784-c32f-46d4-9561-5230aa444231 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:17.893723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:17.895131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:17.895636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:17.898994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] PATH_INFO: `/v3/users/ef1b82099df54d148c0e876e9489c376` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:17.904230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1b82099df54d148c0e876e9489c376)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:17.913064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:17.990399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:17.994236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3ce6e-550d-4a5a-a888-49f733f758f9 service swift] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:18.014977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1335/2611] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:21:18.032226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1b82099df54d148c0e876e9489c376'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.043824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1b82099df54d148c0e876e9489c376'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.074082 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1b82099df54d148c0e876e9489c376'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.074442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1b82099df54d148c0e876e9489c376'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.075155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1b82099df54d148c0e876e9489c376'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.103369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1277/2612] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:17 2022] DELETE /identity/v3/users/ef1b82099df54d148c0e876e9489c376 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:18.107929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f673ef-222f-4225-973a-16abe770c53d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:18.108214 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f673ef-222f-4225-973a-16abe770c53d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:18.108511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f673ef-222f-4225-973a-16abe770c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:18.129432 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-77f673ef-222f-4225-973a-16abe770c53d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:18.130154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-77f673ef-222f-4225-973a-16abe770c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:18.215207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:18.218351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:18.225076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1336/2613] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:18.235852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f673ef-222f-4225-973a-16abe770c53d None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:18.237958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-77f673ef-222f-4225-973a-16abe770c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:18.240240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0409f55-c34f-424a-846f-ffaacbc37d50 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:18.246221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:18.247812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:18.248204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:18.248671 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] PATH_INFO: `/v3/users/a8a3337faba84d0aa85df4121ffb5cd2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:18.250036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a3337faba84d0aa85df4121ffb5cd2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:18.253286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:18.314146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f673ef-222f-4225-973a-16abe770c53d None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:18.318982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:18.319640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:18.319928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:18.320206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:18.330022 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a3337faba84d0aa85df4121ffb5cd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.333263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:18.334839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:18.338912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a3337faba84d0aa85df4121ffb5cd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.347371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a3337faba84d0aa85df4121ffb5cd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.347535 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1337/2614] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:18.348129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a3337faba84d0aa85df4121ffb5cd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.348915 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a3337faba84d0aa85df4121ffb5cd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:18.369910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1278/2615] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:18 2022] DELETE /identity/v3/users/a8a3337faba84d0aa85df4121ffb5cd2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:18.851128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:18.868084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1a1f-07f8-4b42-80e2-2e30c752c385 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:18.890438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:18.892316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:18.949588 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:18.950460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:18.950787 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:18.951094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] PATH_INFO: `/v3/projects/f4149fee898c44c180ae1de15ac9d9da` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:18.952426 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4149fee898c44c180ae1de15ac9d9da)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:18.954358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:18.973001 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4325-fded-4bbe-9ee0-69c598e68a89 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:18.978274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:18.979241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:18.979757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:18.980301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] PATH_INFO: `/v3/projects/b98b8e81b59f44d5a8225bfbbd46c9b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:18.981834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98b8e81b59f44d5a8225bfbbd46c9b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:18.984405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.003196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4149fee898c44c180ae1de15ac9d9da', 'request_id': 'req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.010387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4149fee898c44c180ae1de15ac9d9da', 'request_id': 'req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.020064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4149fee898c44c180ae1de15ac9d9da', 'request_id': 'req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.039037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] The token cache is being invalidate because project f4149fee898c44c180ae1de15ac9d9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:19.039604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.040265 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-e3c06553-de5e-40a8-b769-54a3f9f7e5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.043258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1338/2616] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:18 2022] DELETE /identity/v3/projects/f4149fee898c44c180ae1de15ac9d9da => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:19.046711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98b8e81b59f44d5a8225bfbbd46c9b8', 'request_id': 'req-e8e8e28d-148a-4242-8b8c-80513272635a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.047444 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.047733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.048012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.058073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98b8e81b59f44d5a8225bfbbd46c9b8', 'request_id': 'req-e8e8e28d-148a-4242-8b8c-80513272635a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.068475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98b8e81b59f44d5a8225bfbbd46c9b8', 'request_id': 'req-e8e8e28d-148a-4242-8b8c-80513272635a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.069008 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:19.070231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.090549 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] The token cache is being invalidate because project b98b8e81b59f44d5a8225bfbbd46c9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:19.091302 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.092322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.095301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1279/2617] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:18 2022] DELETE /identity/v3/projects/b98b8e81b59f44d5a8225bfbbd46c9b8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:19.100079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.102773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.135919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1339/2618] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:19.137004 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.138367 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.179462 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e28d-148a-4242-8b8c-80513272635a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.184962 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.185751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.186031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.186541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] PATH_INFO: `/v3/users/6cd5675970074668885897e5ca8c6b1e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.188986 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd5675970074668885897e5ca8c6b1e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.189859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.197864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f66af3-f1a8-4c43-aef6-4bf4ffa6c068 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.201560 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.202199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.202483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.202753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.205147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.243989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd5675970074668885897e5ca8c6b1e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.252765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd5675970074668885897e5ca8c6b1e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.259905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd5675970074668885897e5ca8c6b1e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.260610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd5675970074668885897e5ca8c6b1e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.261268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4974d9b2-d63f-4d36-b1f4-93cab2007a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd5675970074668885897e5ca8c6b1e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.275148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.276582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.282100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1280/2619] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:19 2022] DELETE /identity/v3/users/6cd5675970074668885897e5ca8c6b1e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:19.283700 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.284145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.284571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.301223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1340/2620] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:19.305007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:19.306353 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.401541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1281/2621] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:19.403251 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.405116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.432495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67b67-e795-4787-8b4e-4e86b1684952 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.437177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.437838 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.438113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.438686 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.439337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:19.439629 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.441246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.458138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1341/2622] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:19.462879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.478845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b6865-edae-4bd2-93d4-a2a70ec99695 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.491256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.491957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.492970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.493332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.494300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.496514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.542703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1282/2623] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:19.543995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.557928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8932a51-8b7f-4a00-b767-d47dc015cafe admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.620253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.622211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.628057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.628909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.629776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.630902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.631980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.634136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.640801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e718-6459-4d79-bc88-2edc04b8478a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.649072 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.650279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.662940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.663264 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] PATH_INFO: `/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.665132 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19ec1e62bb64fc792d7043aae8d65f4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.668273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.680167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1342/2624] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:19.682216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.699428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fcdda-5dee-48d5-88ad-3571a22d02e9 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.705491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.707055 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.707364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.710173 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.711323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.714083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.733892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1343/2625] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:19.737602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.743307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19ec1e62bb64fc792d7043aae8d65f4', 'request_id': 'req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.750993 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19ec1e62bb64fc792d7043aae8d65f4', 'request_id': 'req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.762015 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d27-6d5e-4811-bd8f-cd37c3eb8da6 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.764828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19ec1e62bb64fc792d7043aae8d65f4', 'request_id': 'req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.781670 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] The token cache is being invalidate because project b19ec1e62bb64fc792d7043aae8d65f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:19.782102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.783031 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77bbd38d-3d27-4be8-b230-ac6ba27e0ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:19.789081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1283/2626] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:19 2022] DELETE /identity/v3/projects/b19ec1e62bb64fc792d7043aae8d65f4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:19.790818 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61773-1821-4215-9db8-cbf47e8ab161 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.791209 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61773-1821-4215-9db8-cbf47e8ab161 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.791602 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61773-1821-4215-9db8-cbf47e8ab161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.828597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f9c61773-1821-4215-9db8-cbf47e8ab161 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:19.833025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f9c61773-1821-4215-9db8-cbf47e8ab161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.850257 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.851229 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.851814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.851814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.852494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.854227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.867240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1344/2627] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:19.871785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:19.873609 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.887135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3af4a-0388-43fc-aa6b-e22cac7eb933 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:19.892682 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:19.893606 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.894339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.894630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] PATH_INFO: `/v3/projects/982eecb51f594c6faa0a96eefdee92c0/users/e6c3ffb33b4f42a6b36f6a36179d6c2d/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.912280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982eecb51f594c6faa0a96eefdee92c0, user_id=e6c3ffb33b4f42a6b36f6a36179d6c2d, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:19.913110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1284/2628] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:19.915202 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d523ae-f88b-417f-8cdc-d5550089c423 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:19.922064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.922381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.922771 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.936967 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1345/2629] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:19 2022] PUT /identity/v3/projects/982eecb51f594c6faa0a96eefdee92c0/users/e6c3ffb33b4f42a6b36f6a36179d6c2d/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:19.943034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:19.945549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:19.945832 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:19.946101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:19.948580 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:19.977665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] MFA Rules not processed for user `e6c3ffb33b4f42a6b36f6a36179d6c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:19.978922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:20.021535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1285/2630] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:20.025697 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.036066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd081721-93a9-4298-bcb5-18ff9557c0d8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.042249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.042927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.043214 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.043487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.044228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:20.044533 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.046204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.063036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1286/2631] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:21:20.067393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.082365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1346/2632] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:20.083060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf534-b371-48d8-832f-c5a48c4aeccb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.088565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.089324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.089676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.090019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.090783 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.092828 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.093308 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.094738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:20.134112 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1287/2633] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:20 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:20.138073 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.186431 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f19a-5dc7-4fed-b783-843891f0a398 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.213190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a59e-0c49-48fd-97de-c2022d178807 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.218158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.219043 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.219301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.219666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.220621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.222469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.253011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1288/2634] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:20 2022] POST /identity/v3/users => generated 279 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:20.257067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.262182 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.262848 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.263128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.263401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.273552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aefbc-b43d-4bf7-8904-869d7633600f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.279396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.280198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.280472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.281147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.281541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.283499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.297274 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1289/2635] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:20.298157 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.308323 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685eae-d390-4184-ba96-ee762ea36b3f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.313760 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.314421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.314865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.315122 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.316757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.318590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.334208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1290/2636] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:20.335595 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.344926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.345610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f8bf3-6bc7-4a15-ab5b-1b6059a1da44 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.346725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d845e-3841-47ab-8206-616e7d0ed070 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.352198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.352910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.353245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.353592 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] PATH_INFO: `/v3/projects/6e9b491244074aafb30806ac8196e2a6/users/6d122d14d30c41ddad5f12c7b31c55e1/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.357374 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1347/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:20.369203 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9b491244074aafb30806ac8196e2a6, user_id=6d122d14d30c41ddad5f12c7b31c55e1, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.371940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.394943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1291/2638] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:20 2022] PUT /identity/v3/projects/6e9b491244074aafb30806ac8196e2a6/users/6d122d14d30c41ddad5f12c7b31c55e1/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:20.396921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.397211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.397488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.428000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] MFA Rules not processed for user `6d122d14d30c41ddad5f12c7b31c55e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:20.429411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:20.513185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1348/2639] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:20.549396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.551987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:20.629029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec5223-5ace-4f6c-a91b-e3de7fd92307 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.635709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.636587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.636883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.637159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.648201 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.649862 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4dd2-c595-4474-a5e7-7fc0f7ab00c9 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.668292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1292/2640] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:20.689263 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:20.840054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c2d5-3cc3-47a9-b294-e1e926249b1f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:20.853461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:20.855951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.856441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.856941 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] PATH_INFO: `/v3/users/6d122d14d30c41ddad5f12c7b31c55e1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:20.858641 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d122d14d30c41ddad5f12c7b31c55e1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:20.864935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:20.934322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d122d14d30c41ddad5f12c7b31c55e1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:20.941704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d122d14d30c41ddad5f12c7b31c55e1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:20.942469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d122d14d30c41ddad5f12c7b31c55e1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:20.952371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d122d14d30c41ddad5f12c7b31c55e1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:20.953486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d122d14d30c41ddad5f12c7b31c55e1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:20.984544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1349/2641] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:20 2022] DELETE /identity/v3/users/6d122d14d30c41ddad5f12c7b31c55e1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:20.988851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:20.990249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:20.991086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.011233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:21.023057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.123018 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1293/2642] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:21.132088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.133618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.203898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43e3c-f2d8-472a-8431-5082421317e1 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.208719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.209743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.210172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.210346 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.220966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.222231 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c11ae-fc0b-46db-bf21-cf1154a42591 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.232325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1350/2643] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:21.520130 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.522069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.539050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4deff8-0b24-4a83-afd8-b741694e7a77 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.544541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.545452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.545732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.546002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] PATH_INFO: `/v3/projects/6e9b491244074aafb30806ac8196e2a6` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.547547 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9b491244074aafb30806ac8196e2a6)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.550747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.609313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9b491244074aafb30806ac8196e2a6', 'request_id': 'req-39c5b09c-8f29-4037-ae05-cf4fca222f46'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:21.617987 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9b491244074aafb30806ac8196e2a6', 'request_id': 'req-39c5b09c-8f29-4037-ae05-cf4fca222f46'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:21.626212 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9b491244074aafb30806ac8196e2a6', 'request_id': 'req-39c5b09c-8f29-4037-ae05-cf4fca222f46'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:21.639232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] The token cache is being invalidate because project 6e9b491244074aafb30806ac8196e2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:21.639628 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:21.640292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-39c5b09c-8f29-4037-ae05-cf4fca222f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:21.641883 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1294/2644] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:21 2022] DELETE /identity/v3/projects/6e9b491244074aafb30806ac8196e2a6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:21.646864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.647233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.647763 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.668170 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:21.669886 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.735899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1351/2645] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:21.745414 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.745715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.745995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.765240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:21.766523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.776150 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1295/2646] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:21.780601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.793691 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2d52-a3a0-4890-bbfa-3dc654f5c45f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.798927 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.799585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.799862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.800138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.800882 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:21.801187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.803079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.819701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1352/2647] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:21.821356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.831294 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d537-f362-4886-a654-4c0e890f73cf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.837147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.837826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.838108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.838385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.839093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.841200 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.868720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1296/2648] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:21 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:21.873101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.884643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42e02-50a5-4b5a-a40f-ba0c7af447fc admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.961719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.962492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.962846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.963183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.964147 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.966453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.998168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1353/2649] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:21 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:22.002231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.021712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0f49f-65d4-44f6-b137-23a17091f629 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.027832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.028872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.029331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.030023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.030937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.037923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.050854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1297/2650] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:22.054544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.067928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fc84f-a14e-49ff-b19a-1caa61683a15 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.079069 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.081552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.082082 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.082447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.083826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.085643 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ce9a0-1d9e-4d62-8912-4f2923283310 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.102732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1354/2651] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:22.104131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.115968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599a0c-a455-4310-968a-2abab7f47d30 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.121361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.122113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.122386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.122844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] PATH_INFO: `/v3/projects/c747b4ab5b8b45d98ccd5b6a984aa47e/users/bea29b8c1e324b5184563e4614840d9e/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.144571 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c747b4ab5b8b45d98ccd5b6a984aa47e, user_id=bea29b8c1e324b5184563e4614840d9e, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.147951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.179464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1298/2652] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:22 2022] PUT /identity/v3/projects/c747b4ab5b8b45d98ccd5b6a984aa47e/users/bea29b8c1e324b5184563e4614840d9e/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:22.190794 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.191103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.191379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.240038 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] MFA Rules not processed for user `bea29b8c1e324b5184563e4614840d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:22.254619 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:22.402519 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1355/2653] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:22.407084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.547081 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910e97-1bb2-4ac5-9563-dc79f8e8d36d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.563694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.564370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.564841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.565138 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.574727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.574727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.611416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1299/2654] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:22.615743 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.635736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92463946-ad5e-4bf4-916d-4b414beefd01 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.734475 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.735154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.735490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.735765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.736464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.738490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.761920 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1356/2655] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:22 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:22.765801 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.776808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e05-d14d-4741-a174-2b27d86a976d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.781708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.782514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.782797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.783066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.783798 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.785423 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.796889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1300/2656] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:22.801063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.810957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c1e1-2454-4443-bb7f-b72944e41950 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.815506 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.816370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.816679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.816983 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] PATH_INFO: `/v3/projects/3eafcb045154447fb5a91407ad9fabd3/users/9f5899fde76e414386fdf245a8941f40/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.832879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eafcb045154447fb5a91407ad9fabd3, user_id=9f5899fde76e414386fdf245a8941f40, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.836227 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.852000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1357/2657] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:22 2022] PUT /identity/v3/projects/3eafcb045154447fb5a91407ad9fabd3/users/9f5899fde76e414386fdf245a8941f40/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:22.859679 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.869966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0deb2-d528-4ff9-b6ba-c11c42e15a50 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.934223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.934910 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.935213 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.935500 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.936251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.938527 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad365-a7bb-438b-9a64-6be487256053 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.950754 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1301/2658] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:22.954532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.966973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525627dd-ed8b-4060-8bf3-952e36ededda admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.971868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.972994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.973281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.973556 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] PATH_INFO: `/v3/projects/3eafcb045154447fb5a91407ad9fabd3/users/9f5899fde76e414386fdf245a8941f40/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.976120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eafcb045154447fb5a91407ad9fabd3, user_id=9f5899fde76e414386fdf245a8941f40, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.979186 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.991958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1358/2659] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:22 2022] PUT /identity/v3/projects/3eafcb045154447fb5a91407ad9fabd3/users/9f5899fde76e414386fdf245a8941f40/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:23.005938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:23.006725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:23.006725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:23.040245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] MFA Rules not processed for user `9f5899fde76e414386fdf245a8941f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:23.041658 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:23.136273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1302/2660] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:23.144394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:23.147237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:23.218545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340132-0b0d-4e41-98bc-85e23a79d34f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:23.222209 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:23.222861 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:23.223140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:23.223412 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:23.287814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:23.289045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347487e-205d-461f-b388-f61eafbc11b4 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:23.300911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1359/2661] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:23.320497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:23.320497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:23.405343 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c6a7a-18ef-4eae-a797-365c0daa5bbf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:23.413078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:23.414240 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:23.414512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:23.414787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] PATH_INFO: `/v3/users/e6c3ffb33b4f42a6b36f6a36179d6c2d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:23.416159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c3ffb33b4f42a6b36f6a36179d6c2d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:23.418311 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:23.477488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c3ffb33b4f42a6b36f6a36179d6c2d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:23.485693 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c3ffb33b4f42a6b36f6a36179d6c2d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:23.495906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c3ffb33b4f42a6b36f6a36179d6c2d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:23.497246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c3ffb33b4f42a6b36f6a36179d6c2d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:23.498083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c3ffb33b4f42a6b36f6a36179d6c2d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:23.529233 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1303/2662] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:23 2022] DELETE /identity/v3/users/e6c3ffb33b4f42a6b36f6a36179d6c2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:23.535112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:23.535462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:23.535786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:23.564570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:23.566462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:23.645917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1360/2663] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:23.652145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:23.654046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:23.747135 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a493063-7816-47a2-acf7-bf531504f125 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:23.759541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:23.760333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:23.760719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:23.761029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:23.775160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:23.777292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55be5c-22d2-44fa-aa94-308def671548 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:23.790854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1304/2664] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:24.135995 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.137622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:24.157105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8a800-4e06-4610-b4aa-d8b880218ff6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.163999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.165511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.165952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.166280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] PATH_INFO: `/v3/projects/982eecb51f594c6faa0a96eefdee92c0` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.167529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982eecb51f594c6faa0a96eefdee92c0)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.169477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.215330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982eecb51f594c6faa0a96eefdee92c0', 'request_id': 'req-d9351b73-6454-4f5d-8062-83d0be094e58'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:24.222437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982eecb51f594c6faa0a96eefdee92c0', 'request_id': 'req-d9351b73-6454-4f5d-8062-83d0be094e58'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:24.231336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982eecb51f594c6faa0a96eefdee92c0', 'request_id': 'req-d9351b73-6454-4f5d-8062-83d0be094e58'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:24.243369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] The token cache is being invalidate because project 982eecb51f594c6faa0a96eefdee92c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:24.243656 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:24.244375 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d9351b73-6454-4f5d-8062-83d0be094e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:24.246239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1361/2665] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:24 2022] DELETE /identity/v3/projects/982eecb51f594c6faa0a96eefdee92c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:24.250869 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.251807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.252086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.273538 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:24.274728 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:24.345863 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1305/2666] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:24.353894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.354237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.354488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.376461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:24.377720 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:24.386826 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1362/2667] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:24.391088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.403050 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f4bee-d19e-48ee-af60-a50bcb561834 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.408345 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.409151 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.409433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.409702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.410842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:24.410842 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.412494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.425638 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1306/2668] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:21:24.429775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.441964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3101ae-4158-4b1f-8cd9-9442095e3200 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.448146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.449126 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.449511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.449889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.450699 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.452733 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.480030 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1363/2669] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:24.484090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.494745 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749877-6428-4930-bc20-d2ae623d64ec admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.556625 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.557398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.557751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.558115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.558877 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.560905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.581420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1307/2670] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:24.586244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.596602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925b2f-e5bc-4feb-ba49-19132260e75a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.602508 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.603259 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.603548 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.603824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.604778 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.606364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.617149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1364/2671] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:24.621092 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.632939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a3ff-4405-4a37-b7fa-02619756f8f6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.637684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.638463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.638845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.639220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.640045 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.641810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b9ee-3e6d-442d-963d-d529083890d7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.653569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1308/2672] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:24.657928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.667932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e145-724e-4848-a1cc-8a002805dd18 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.673905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.673905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.674378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.674757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] PATH_INFO: `/v3/projects/d1e374dab47942eabb6b8918d44b1521/users/6608c8599e3d4cbaa98b5fb77c251991/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.690759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e374dab47942eabb6b8918d44b1521, user_id=6608c8599e3d4cbaa98b5fb77c251991, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.694335 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.713156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1365/2673] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:24 2022] PUT /identity/v3/projects/d1e374dab47942eabb6b8918d44b1521/users/6608c8599e3d4cbaa98b5fb77c251991/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:24.726486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.727041 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.727405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.760947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] MFA Rules not processed for user `6608c8599e3d4cbaa98b5fb77c251991`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:24.762774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:24.846417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1309/2674] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:24.851176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.939498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece4b63-a46e-4ea7-ad95-1e51de7f527b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:24.945918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:24.946732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.947108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.947717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.948464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:24.950599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:24.978095 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1366/2675] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:24.982740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:24.996069 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f96d03-f93c-4f14-b288-5df80f887e92 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.071369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.072568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.073344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.073702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.074524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.077019 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.107296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1310/2676] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:25.109034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.127871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad498-a6ee-470e-be35-19cbb90f6ebb admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.134798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.136041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.136621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.136621 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.137372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.139482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.150955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1367/2677] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:25.155237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.168272 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d331a-f7fe-4768-89e4-83f5884836e9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.171747 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.172636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.172952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.173220 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] PATH_INFO: `/v3/projects/822ff66b591248709cfcd2580c770873/users/16e857e96151487296051deb32921638/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.189451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822ff66b591248709cfcd2580c770873, user_id=16e857e96151487296051deb32921638, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.192085 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.208004 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1311/2678] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:25 2022] PUT /identity/v3/projects/822ff66b591248709cfcd2580c770873/users/16e857e96151487296051deb32921638/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:25.212102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.224753 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744039b8-e2f3-491b-9df7-c60314ec071c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.304270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.305211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.305499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.306793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.307801 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.310446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601cade-485c-4d8b-afd4-5eeee635d948 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.325303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1368/2679] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:25.330030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.343897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fdff7-a184-4288-ab50-5586716f07e4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.348587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.350193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.350468 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.350740 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] PATH_INFO: `/v3/projects/822ff66b591248709cfcd2580c770873/users/16e857e96151487296051deb32921638/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.352773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822ff66b591248709cfcd2580c770873, user_id=16e857e96151487296051deb32921638, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.356383 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.368935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1312/2680] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:25 2022] PUT /identity/v3/projects/822ff66b591248709cfcd2580c770873/users/16e857e96151487296051deb32921638/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:25.379785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016510-5186-4390-b300-11294229e873 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.380113 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016510-5186-4390-b300-11294229e873 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.381042 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016510-5186-4390-b300-11294229e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.408080 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-0f016510-5186-4390-b300-11294229e873 None None] MFA Rules not processed for user `16e857e96151487296051deb32921638`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:25.409464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-0f016510-5186-4390-b300-11294229e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:25.495908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1369/2681] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:25.508066 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.509803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:25.571530 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7524043-5d62-4ebd-84b8-5a6b0c4e3658 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.575489 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.576166 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.576472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.576776 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.587559 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.589083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.602931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1313/2682] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:25.674804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016510-5186-4390-b300-11294229e873 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.685138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016510-5186-4390-b300-11294229e873 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:25.689442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:25.690108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:25.690394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:25.690670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:25.761966 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:25.763813 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:25.777534 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1370/2683] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:25.989633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:25.991377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.058793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.062816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.096327 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78d94b-f081-46f9-87a3-75750bc9ee2a service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.101535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.102553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.102827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.103142 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] PATH_INFO: `/v3/users/bea29b8c1e324b5184563e4614840d9e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.104307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea29b8c1e324b5184563e4614840d9e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.106400 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.144218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4527f0-469e-402a-a30c-7389b0812fa2 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.148919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.149822 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.150106 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.150377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] PATH_INFO: `/v3/users/a18ecdf65b7c42e0aeb44519eaaff743` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.151563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18ecdf65b7c42e0aeb44519eaaff743)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.153569 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.159106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea29b8c1e324b5184563e4614840d9e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.167521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea29b8c1e324b5184563e4614840d9e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.174320 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea29b8c1e324b5184563e4614840d9e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.174971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea29b8c1e324b5184563e4614840d9e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.175552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-387a7ba5-d58e-48b1-bdcb-4faf0ae9fd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea29b8c1e324b5184563e4614840d9e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.194110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1314/2684] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:25 2022] DELETE /identity/v3/users/bea29b8c1e324b5184563e4614840d9e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:26.198363 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.198642 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.198963 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.204138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18ecdf65b7c42e0aeb44519eaaff743'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.210916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18ecdf65b7c42e0aeb44519eaaff743'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.211584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18ecdf65b7c42e0aeb44519eaaff743'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.215411 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:26.216699 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.219274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18ecdf65b7c42e0aeb44519eaaff743'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.219993 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18ecdf65b7c42e0aeb44519eaaff743'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.244352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1371/2685] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/users/a18ecdf65b7c42e0aeb44519eaaff743 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:26.275953 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1315/2686] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:26.289974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.292258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.357419 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd34758-f471-4e4e-a4cd-634a6fac8867 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.362618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.363270 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.363594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.363872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.445368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.446788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.459293 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1372/2687] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:26.462984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.464377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.477225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3780b-0aa9-48e8-b3b1-9cc61356f084 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.482445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.484113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.484567 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.485068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] PATH_INFO: `/v3/projects/b79f1de979384c108b5ff0427e44e30b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.487601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79f1de979384c108b5ff0427e44e30b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.490673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.555251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79f1de979384c108b5ff0427e44e30b', 'request_id': 'req-9d6ea976-73ff-4e10-83c1-33fd2f701df4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.564570 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79f1de979384c108b5ff0427e44e30b', 'request_id': 'req-9d6ea976-73ff-4e10-83c1-33fd2f701df4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.572725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79f1de979384c108b5ff0427e44e30b', 'request_id': 'req-9d6ea976-73ff-4e10-83c1-33fd2f701df4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.588044 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] The token cache is being invalidate because project b79f1de979384c108b5ff0427e44e30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:26.588443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.589433 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.591434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1316/2688] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/projects/b79f1de979384c108b5ff0427e44e30b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:26.595700 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.616336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30df-c244-4039-9195-ee3c64e59802 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.701058 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.702074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.702395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.702687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] PATH_INFO: `/v3/users/e97379f441174f23a9fb2e9e747d9fa8` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.703988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97379f441174f23a9fb2e9e747d9fa8)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.706018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.755850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97379f441174f23a9fb2e9e747d9fa8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.764189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97379f441174f23a9fb2e9e747d9fa8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.764974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97379f441174f23a9fb2e9e747d9fa8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.774734 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97379f441174f23a9fb2e9e747d9fa8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.775362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97379f441174f23a9fb2e9e747d9fa8'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.784178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.786599 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.794833 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1373/2689] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/users/e97379f441174f23a9fb2e9e747d9fa8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:26.807965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea976-73ff-4e10-83c1-33fd2f701df4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.866454 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:26.867236 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:26.867515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:26.867793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] PATH_INFO: `/v3/projects/c747b4ab5b8b45d98ccd5b6a984aa47e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:26.869037 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c747b4ab5b8b45d98ccd5b6a984aa47e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:26.870958 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:26.918984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c747b4ab5b8b45d98ccd5b6a984aa47e', 'request_id': 'req-bee7463d-9e19-4fcc-b594-570951fdbabc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.925263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c747b4ab5b8b45d98ccd5b6a984aa47e', 'request_id': 'req-bee7463d-9e19-4fcc-b594-570951fdbabc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.932844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c747b4ab5b8b45d98ccd5b6a984aa47e', 'request_id': 'req-bee7463d-9e19-4fcc-b594-570951fdbabc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.944481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] The token cache is being invalidate because project c747b4ab5b8b45d98ccd5b6a984aa47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:26.944788 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.946097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:26.947786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1317/2690] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/projects/c747b4ab5b8b45d98ccd5b6a984aa47e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:26.953447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.955054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:26.972808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:26.974072 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579143-3810-4e1a-a540-25f8a2c2f460 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:26.979435 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:27.050330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.050492 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.050799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.051137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] PATH_INFO: `/v3/users/9f5899fde76e414386fdf245a8941f40` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.053083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5899fde76e414386fdf245a8941f40)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.055247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.060437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7463d-9e19-4fcc-b594-570951fdbabc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.066286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.066750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.067039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.067317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] PATH_INFO: `/v3/projects/513434fe6f004d5593457f20b2272567` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.069550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=513434fe6f004d5593457f20b2272567)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.071473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.109399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5899fde76e414386fdf245a8941f40'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.117851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5899fde76e414386fdf245a8941f40'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.118479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5899fde76e414386fdf245a8941f40'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.123099 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513434fe6f004d5593457f20b2272567', 'request_id': 'req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.127184 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5899fde76e414386fdf245a8941f40'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.127820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5899fde76e414386fdf245a8941f40'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.128918 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513434fe6f004d5593457f20b2272567', 'request_id': 'req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.138726 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513434fe6f004d5593457f20b2272567', 'request_id': 'req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.148233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1374/2691] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/users/9f5899fde76e414386fdf245a8941f40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:27.152449 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] The token cache is being invalidate because project 513434fe6f004d5593457f20b2272567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:27.152773 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.153461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3f09475-d8f3-4f64-9e42-2f9b8bcab86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.156371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1318/2692] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:26 2022] DELETE /identity/v3/projects/513434fe6f004d5593457f20b2272567 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:27.496083 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:27.498154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:27.565568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918227-34fc-47d5-99a1-416a4601c344 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.570416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.571261 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.571540 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.571810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] PATH_INFO: `/v3/projects/3eafcb045154447fb5a91407ad9fabd3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.572988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eafcb045154447fb5a91407ad9fabd3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.574857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.619169 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eafcb045154447fb5a91407ad9fabd3', 'request_id': 'req-869e93ad-9871-4995-a710-511444d32be4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.625219 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eafcb045154447fb5a91407ad9fabd3', 'request_id': 'req-869e93ad-9871-4995-a710-511444d32be4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.632248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eafcb045154447fb5a91407ad9fabd3', 'request_id': 'req-869e93ad-9871-4995-a710-511444d32be4'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.643683 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] The token cache is being invalidate because project 3eafcb045154447fb5a91407ad9fabd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:27.643980 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.644773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-869e93ad-9871-4995-a710-511444d32be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:27.646403 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1375/2693] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:27 2022] DELETE /identity/v3/projects/3eafcb045154447fb5a91407ad9fabd3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:27.651472 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.651965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.652173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.670767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:27.671947 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:27.728799 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1319/2694] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:27.738709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.739016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.739836 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.759076 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:27.760281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:27.768484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1376/2695] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:27.773586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:27.783481 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3951a-6d32-4a4e-b7be-41a7a0764e35 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.789246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.790163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.790339 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.790601 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.791369 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:27.791678 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.793340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.810216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1320/2696] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:27.811091 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:27.820843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24499-1c22-45a9-b0d7-d7be5720aee3 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.825527 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.826183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.826468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.826821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.827470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.829400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.860145 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1377/2697] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:27.861421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:27.872115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87201c56-9a17-4d38-8fa6-0a0727f76327 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.932313 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.932981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.933262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.933535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.934226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.937426 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.956688 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1321/2698] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:27 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:27.961125 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:27.971234 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532dc4a-eb83-4688-9c4f-69f543a0425b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:27.976479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:27.977158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:27.977436 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:27.977703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:27.978411 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:27.979977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:27.990223 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1378/2699] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:27.994356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:28.004221 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405c75-45e0-40a8-a858-ac06a806a73c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:28.008849 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:28.009495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:28.009774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:28.010049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:28.010766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:28.012358 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6b50-e223-475a-9cd0-bb8adbf2ab4b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:28.022476 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1322/2700] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:28.026659 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:28.038325 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86389b-a609-47f8-b875-31423d53169e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:28.043034 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:28.043903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:28.044183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:28.044461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] PATH_INFO: `/v3/projects/35fe0757d8d1413888c4c7e6a70983a0/users/e0891388a65a43a7b493681e43084a32/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:28.059517 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fe0757d8d1413888c4c7e6a70983a0, user_id=e0891388a65a43a7b493681e43084a32, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:28.062241 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:28.077253 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1379/2701] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:28 2022] PUT /identity/v3/projects/35fe0757d8d1413888c4c7e6a70983a0/users/e0891388a65a43a7b493681e43084a32/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:28.095232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:28.095548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:28.095827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:28.122587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] MFA Rules not processed for user `e0891388a65a43a7b493681e43084a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:28.123765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:28.186469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1323/2702] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:28.197754 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:28.199593 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:28.256352 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047e3a-3b6b-4a15-89f6-f5f7c483134a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:28.259985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:28.260625 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:28.260939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:28.261211 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:28.269228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:28.271200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff3d6-8af4-43dc-9bc7-d098ec1b40bd service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:28.279919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1380/2703] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:32.278395 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:32.342438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebf072-c03a-4581-aaba-1c1ed3ff0ca1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:32.347032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:32.347913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:32.348199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:32.348471 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] PATH_INFO: `/v3/users/e0891388a65a43a7b493681e43084a32` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:32.351750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0891388a65a43a7b493681e43084a32)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:32.354136 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:32.407422 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0891388a65a43a7b493681e43084a32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.415682 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0891388a65a43a7b493681e43084a32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.424237 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0891388a65a43a7b493681e43084a32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.424943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0891388a65a43a7b493681e43084a32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.425552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0891388a65a43a7b493681e43084a32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.444076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1324/2704] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:32 2022] DELETE /identity/v3/users/e0891388a65a43a7b493681e43084a32 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:32.448448 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:32.448976 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:32.449073 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:32.465948 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:32.467115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:32.525462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1381/2705] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:32.535689 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:32.538382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:32.593916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923939c7-ce66-4fd1-b31d-c11f74429034 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:32.597561 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:32.598198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:32.598475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:32.598743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:32.608507 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:32.609951 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce73f0-ebb8-4dd9-b1aa-ec7254d32db6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:32.619455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1325/2706] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:32.889292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:32.891549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:32.907576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9e3bd-424a-4d2d-9b0e-f0fcd05d544f None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:32.913387 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:32.914324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:32.914599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:32.914877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] PATH_INFO: `/v3/projects/35fe0757d8d1413888c4c7e6a70983a0` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:32.921696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fe0757d8d1413888c4c7e6a70983a0)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:32.923797 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:32.969277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fe0757d8d1413888c4c7e6a70983a0', 'request_id': 'req-4c5a2566-421c-42b3-a1a4-011aba7a888f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.974704 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fe0757d8d1413888c4c7e6a70983a0', 'request_id': 'req-4c5a2566-421c-42b3-a1a4-011aba7a888f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.981810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fe0757d8d1413888c4c7e6a70983a0', 'request_id': 'req-4c5a2566-421c-42b3-a1a4-011aba7a888f'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.993565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] The token cache is being invalidate because project 35fe0757d8d1413888c4c7e6a70983a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:32.993877 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.994602 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4c5a2566-421c-42b3-a1a4-011aba7a888f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:32.996358 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1382/2707] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:32 2022] DELETE /identity/v3/projects/35fe0757d8d1413888c4c7e6a70983a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:33.001572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.001931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.002275 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.021552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:33.022813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:33.085622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1326/2708] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:33.094405 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.094709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.094985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.113115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:33.114302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:33.122678 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1383/2709] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:33.126724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.137241 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2405a38-975c-4e1f-bcf8-f5ad03b51775 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.141793 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.142445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.142730 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.143007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.143736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:33.144046 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.145720 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.157840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1327/2710] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:33.161951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.170834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73f911-f8b4-4b4e-a1c7-fabf7168a2e6 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.175446 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.176089 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.176373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.176667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.177953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.179847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.203956 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1384/2711] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:33 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:33.207933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.218729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dace4-8bab-42c5-9494-47d4b9d21fbe admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.273473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.274059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.274341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.274616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.275295 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.277225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.296633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1328/2712] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:33 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:33.300638 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.310701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072290de-c63d-4e39-bc8b-d00dbdb4f99c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.315226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.315871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.316153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.316424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.317176 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.318954 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.328846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1385/2713] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:33.332508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.342669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3fc4-b2ca-4eb9-91ee-7d4f454a146e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.347319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.347960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.348238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.348508 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.349880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.351448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8f7d-e546-471a-bc9f-d159ef676e6f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.360970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1329/2714] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:33.364933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.374442 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d6e5-3981-4ef1-9d11-ef67983feb4f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.378994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.379851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.380141 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.380959 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] PATH_INFO: `/v3/projects/857a0b74b3cd4535983ee99357aaba5b/users/9e0c122b00db49dfb3bb837a04266dd2/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.395056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=857a0b74b3cd4535983ee99357aaba5b, user_id=9e0c122b00db49dfb3bb837a04266dd2, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.398368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.411907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1386/2715] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:33 2022] PUT /identity/v3/projects/857a0b74b3cd4535983ee99357aaba5b/users/9e0c122b00db49dfb3bb837a04266dd2/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:33.422172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.422458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.422756 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.450870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] MFA Rules not processed for user `9e0c122b00db49dfb3bb837a04266dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:33.452076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:33.517336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1330/2716] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:33.529364 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:33.531435 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:33.588399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62985c2-375a-4642-b2ff-71fcb785cb4f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:33.592252 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:33.592929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:33.593233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:33.593500 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:33.602402 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:33.603844 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:33.612760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1387/2717] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:35.287269 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:35.289752 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:35.356839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a3151-4afa-4e79-b36d-a68c42589c89 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:35.361306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:35.362174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:35.362452 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:35.362725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] PATH_INFO: `/v3/users/4609c85923df4a18a09dfad8759d06ca` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:35.363907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4609c85923df4a18a09dfad8759d06ca)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:35.366829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:35.409391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4609c85923df4a18a09dfad8759d06ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.416666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4609c85923df4a18a09dfad8759d06ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.423305 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4609c85923df4a18a09dfad8759d06ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.423948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4609c85923df4a18a09dfad8759d06ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.424544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4609c85923df4a18a09dfad8759d06ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.442189 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1331/2718] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:35 2022] DELETE /identity/v3/users/4609c85923df4a18a09dfad8759d06ca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:35.613142 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:35.624978 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fcc86-87a8-4528-8d6a-d56d0dd551cf service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:35.682781 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:35.683637 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:35.683918 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:35.684193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] PATH_INFO: `/v3/projects/d537921027294716af9874389628492c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:35.685389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d537921027294716af9874389628492c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:35.687283 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:35.731316 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd537921027294716af9874389628492c', 'request_id': 'req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.736526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd537921027294716af9874389628492c', 'request_id': 'req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.744280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd537921027294716af9874389628492c', 'request_id': 'req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.754878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] The token cache is being invalidate because project d537921027294716af9874389628492c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:35.755153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.756228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.757796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1388/2719] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:35 2022] DELETE /identity/v3/projects/d537921027294716af9874389628492c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:35.761692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:35.763068 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:35.776230 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6525341-f491-4de2-82e0-d1fc14db7abb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:35.831512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:35.832380 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:35.832673 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:35.833025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] PATH_INFO: `/v3/users/e377d80adb34491c9ffa32312de44490` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:35.834225 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e377d80adb34491c9ffa32312de44490)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:35.836119 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:35.879370 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e377d80adb34491c9ffa32312de44490'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.885839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e377d80adb34491c9ffa32312de44490'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.892708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e377d80adb34491c9ffa32312de44490'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.893325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e377d80adb34491c9ffa32312de44490'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.893903 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e377d80adb34491c9ffa32312de44490'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:35.910634 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1332/2720] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:35 2022] DELETE /identity/v3/users/e377d80adb34491c9ffa32312de44490 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:36.080799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.082376 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.096872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6961-87b8-4aad-a862-3dfd1d6ae2ea admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.168392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.169932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.175049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.175697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.175982 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.176255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] PATH_INFO: `/v3/projects/1071d4df1185488d9b7680af88e7dbb3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.177565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1071d4df1185488d9b7680af88e7dbb3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.179930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.184246 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111f14-ba27-40ab-87ef-b000ce727e7b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.191040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.192090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.192379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.192687 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] PATH_INFO: `/v3/users/9e0c122b00db49dfb3bb837a04266dd2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.193942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0c122b00db49dfb3bb837a04266dd2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.195866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.231557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1071d4df1185488d9b7680af88e7dbb3', 'request_id': 'req-724f6a67-9dd4-4657-aadf-fa4113123516'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.238105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1071d4df1185488d9b7680af88e7dbb3', 'request_id': 'req-724f6a67-9dd4-4657-aadf-fa4113123516'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.246884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1071d4df1185488d9b7680af88e7dbb3', 'request_id': 'req-724f6a67-9dd4-4657-aadf-fa4113123516'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.255208 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0c122b00db49dfb3bb837a04266dd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.260867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] The token cache is being invalidate because project 1071d4df1185488d9b7680af88e7dbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:36.261244 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.261999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-724f6a67-9dd4-4657-aadf-fa4113123516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.263183 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0c122b00db49dfb3bb837a04266dd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.268933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1389/2721] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:36 2022] DELETE /identity/v3/projects/1071d4df1185488d9b7680af88e7dbb3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:36.270307 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c148c-d1ef-4f6f-b8e2-3d139f1e5a80 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.270591 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c148c-d1ef-4f6f-b8e2-3d139f1e5a80 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.270864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c148c-d1ef-4f6f-b8e2-3d139f1e5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.275858 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0c122b00db49dfb3bb837a04266dd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.277263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0c122b00db49dfb3bb837a04266dd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.277872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd835812-3909-41ac-9371-c6ab724a869b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0c122b00db49dfb3bb837a04266dd2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.291366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-975c148c-d1ef-4f6f-b8e2-3d139f1e5a80 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:36.292547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-975c148c-d1ef-4f6f-b8e2-3d139f1e5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.297181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1333/2722] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:36 2022] DELETE /identity/v3/users/9e0c122b00db49dfb3bb837a04266dd2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:36.301334 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.301616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.301887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.319059 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:36.320266 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.363429 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1390/2723] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:36.371611 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.372187 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.372462 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.380057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1334/2724] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:36.391362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.391851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:36.392809 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.393001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.405382 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1391/2725] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:36.406378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.415297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6782ee-6173-43e2-a4bd-8b232d1bc5b5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.420297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.421002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.421280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.421564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.422303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:36.422608 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.424313 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.436726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1392/2726] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:36.440975 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.451692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573273b4-a4bb-4309-a6ba-102fc5332484 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.452790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac93c-3e76-4201-afe8-c67ce8868d28 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.456863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.457020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.457499 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.457610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.457777 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.457894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.458048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.458147 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.459338 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.461748 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.469268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.470938 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.481606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1335/2727] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:36.493565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1393/2728] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:36.494984 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.507692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbb37-a506-4c4e-bfc4-3b3f104d41c6 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.567429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.568639 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.568957 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.569222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.569908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.571855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.595185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1336/2729] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:36.596955 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.607437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996c392-86d2-4463-b0b1-33c58e721dd3 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.612273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.612997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.613275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.613850 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.614258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.615893 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.626239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1394/2730] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:36.630083 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.646606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5759d-b55c-4ac7-bdf8-a05ae4ff43d6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.651750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.652416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.652721 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.653155 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.653885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.655732 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74225b-1234-46f9-abe8-865869375ae9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.666285 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1337/2731] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:36.670323 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.681114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e714e9-6c7f-4db3-8ca4-b883855b8da7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.685772 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.686644 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.686925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.687203 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] PATH_INFO: `/v3/projects/d47a4a74e308426a9f5318f36c35fa59/users/f7bd99487b014788aa1f003f182f9147/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.702090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47a4a74e308426a9f5318f36c35fa59, user_id=f7bd99487b014788aa1f003f182f9147, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.704757 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.718153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1395/2732] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:36 2022] PUT /identity/v3/projects/d47a4a74e308426a9f5318f36c35fa59/users/f7bd99487b014788aa1f003f182f9147/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:36.728866 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.729182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.729458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.752220 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.753997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.761444 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] MFA Rules not processed for user `f7bd99487b014788aa1f003f182f9147`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:36.762573 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.818834 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba570-133e-46c4-af8f-d83f55f4729f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.823381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.824225 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.824509 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.824880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] PATH_INFO: `/v3/projects/857a0b74b3cd4535983ee99357aaba5b` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.826056 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=857a0b74b3cd4535983ee99357aaba5b)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:36.827936 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:36.828254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1338/2733] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:36.840486 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:36.841912 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.873876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857a0b74b3cd4535983ee99357aaba5b', 'request_id': 'req-4ba150cf-797c-43e3-89d2-823596e49caf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.879665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857a0b74b3cd4535983ee99357aaba5b', 'request_id': 'req-4ba150cf-797c-43e3-89d2-823596e49caf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.887937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857a0b74b3cd4535983ee99357aaba5b', 'request_id': 'req-4ba150cf-797c-43e3-89d2-823596e49caf'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.905437 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2867-8303-459f-96d3-eb3c2755e476 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:36.905912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] The token cache is being invalidate because project 857a0b74b3cd4535983ee99357aaba5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80056) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:36.906381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.907354 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:36.909846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1396/2734] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:36 2022] DELETE /identity/v3/projects/857a0b74b3cd4535983ee99357aaba5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:36.963381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e8a60a8ef644e691a9a501ad2a4104', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:36.964087 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.964347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.964622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.966940 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:37.034562 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:37.035930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbb8d9-ab43-412b-a751-7accfe64da60 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:37.050643 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1339/2735] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:57.738401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:57.739974 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:57.803526 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba150cf-797c-43e3-89d2-823596e49caf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:57.808121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:57.809019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:57.809299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:57.809578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] PATH_INFO: `/v3/users/f7bd99487b014788aa1f003f182f9147` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:57.811269 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bd99487b014788aa1f003f182f9147)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:57.813199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:57.861102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bd99487b014788aa1f003f182f9147'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:57.868064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bd99487b014788aa1f003f182f9147'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:57.868860 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bd99487b014788aa1f003f182f9147'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:57.876938 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bd99487b014788aa1f003f182f9147'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:57.877652 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bd99487b014788aa1f003f182f9147'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:57.895725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1397/2736] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:21:57 2022] DELETE /identity/v3/users/f7bd99487b014788aa1f003f182f9147 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:57.900134 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:57.900624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:57.901161 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:57.919515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:57.921410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:57.978887 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1340/2737] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:57.989288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:57.990661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.045773 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0cbf9-584f-4592-8e28-b4c3cd304fae admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.049394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.050060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.050324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.050599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.059824 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.062092 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6ffe-863a-45d0-8fc5-04787640a457 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.072094 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1398/2738] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:58.324921 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.326466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.338490 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242ba7-407c-45c3-b65c-9ff579dd8e84 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.344063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.344979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.345258 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.345535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] PATH_INFO: `/v3/projects/d47a4a74e308426a9f5318f36c35fa59` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.346719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47a4a74e308426a9f5318f36c35fa59)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.348627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.393020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47a4a74e308426a9f5318f36c35fa59', 'request_id': 'req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:58.398404 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47a4a74e308426a9f5318f36c35fa59', 'request_id': 'req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:58.406322 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47a4a74e308426a9f5318f36c35fa59', 'request_id': 'req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:58.417078 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] The token cache is being invalidate because project d47a4a74e308426a9f5318f36c35fa59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:58.417361 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:58.417970 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bb10856f-7bf8-48a0-80b7-5003df9ad9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:58.419509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1341/2739] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:21:58 2022] DELETE /identity/v3/projects/d47a4a74e308426a9f5318f36c35fa59 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:58.425135 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.425424 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.425701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.442388 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:58.443613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.502736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1399/2740] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:58.511349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.511632 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.511906 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.530397 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:58.531574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.539300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1342/2741] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:58.543395 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.553480 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfef78-ba56-4e43-91be-0a63551bb622 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.558057 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.558721 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.559007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.559272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.559998 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:58.560303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.561951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.573495 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1400/2742] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:58.578016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.587060 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e863c3-f1db-49b1-97ed-7a12c3eecb1b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.591677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.593063 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.593347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.593613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.594296 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.596186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.620950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1343/2743] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:21:58 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:58.625168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.634799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee57-c1af-4232-9fb2-d29a974f820a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.689067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.689724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.690003 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.690276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.690963 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.692885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.714657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1401/2744] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:21:58 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:58.715813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.726372 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931441a-370c-45c9-981d-14364c325407 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.730787 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.731434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.731710 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.731980 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.732810 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.734548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.745609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1344/2745] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:58.749774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.759736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a5b0-9e64-4709-80b9-402727b8d22f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.765196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.765851 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.766264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.766441 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.767302 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.769009 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209979a-b9c6-41da-b30f-df5b53ad8fac admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.780792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1402/2746] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:58.784144 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.794223 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179936b5-fa12-45a1-a8e6-5558a908b12f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.799303 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.800184 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.800467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.800778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] PATH_INFO: `/v3/projects/c224356accca4d1bbf7a2440aa0d9b89/users/b862c7d5db4749879a441b2a90621d7c/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.815009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c224356accca4d1bbf7a2440aa0d9b89, user_id=b862c7d5db4749879a441b2a90621d7c, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.817692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:58.830879 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1345/2747] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:21:58 2022] PUT /identity/v3/projects/c224356accca4d1bbf7a2440aa0d9b89/users/b862c7d5db4749879a441b2a90621d7c/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:58.835815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc266f78-0edc-4d1d-9569-87edaeae693c None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.836105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc266f78-0edc-4d1d-9569-87edaeae693c None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.836383 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc266f78-0edc-4d1d-9569-87edaeae693c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.853356 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-bc266f78-0edc-4d1d-9569-87edaeae693c None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:58.854537 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-bc266f78-0edc-4d1d-9569-87edaeae693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.912903 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1403/2748] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:58.922686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:58.924401 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:58.979090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed41db-1646-404d-b13f-4dc7a1d38d79 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:58.982668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:58.983408 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:58.983846 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:58.984115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:58.994277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:58.995725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:59.006216 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1346/2749] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:59.600355 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8078-2569-4c45-83a7-9f560e303e96 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:59.600764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8078-2569-4c45-83a7-9f560e303e96 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:59.601130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8078-2569-4c45-83a7-9f560e303e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:59.627585 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e55f8078-2569-4c45-83a7-9f560e303e96 None None] MFA Rules not processed for user `b862c7d5db4749879a441b2a90621d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:59.629045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e55f8078-2569-4c45-83a7-9f560e303e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:59.693939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1404/2750] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:59.704692 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:59.706110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:59.761512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ad5d-ce85-4c2a-b749-faac37b17f38 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:59.765310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:59.765952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:59.766245 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:59.766496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:59.782808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:59.784254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:59.793206 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1347/2751] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:21:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:01.122647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:01.123222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:01.123373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:01.141898 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] MFA Rules not processed for user `b862c7d5db4749879a441b2a90621d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:01.143149 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:01.150552 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1405/2752] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:22:01.390653 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:01.399955 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42bed-f41a-4403-aefa-3878a34f5740 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:01.403523 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:01.404160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:01.405293 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:01.405579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:01.407366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:01.416715 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:01.418133 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8b97b-cd40-4a45-8d53-9f9671524a19 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:01.426514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1348/2753] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:03.979264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:03.980865 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:03.994329 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e452e-f7fb-4f72-945b-aa2a1d5c1ee4 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:03.998807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:04.000301 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:04.000573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:04.001007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] PATH_INFO: `/v3/users/6608c8599e3d4cbaa98b5fb77c251991` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:04.002218 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6608c8599e3d4cbaa98b5fb77c251991)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:04.004159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:04.051054 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6608c8599e3d4cbaa98b5fb77c251991'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.058632 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6608c8599e3d4cbaa98b5fb77c251991'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.059438 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6608c8599e3d4cbaa98b5fb77c251991'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.067455 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6608c8599e3d4cbaa98b5fb77c251991'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.068576 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6608c8599e3d4cbaa98b5fb77c251991'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.087236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1406/2754] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:03 2022] DELETE /identity/v3/users/6608c8599e3d4cbaa98b5fb77c251991 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:04.091941 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:04.092420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:04.093396 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:04.110742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:04.111933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:04.169979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1349/2755] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:04.179997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:04.181430 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:04.237957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c83b8-60d7-4283-a28c-a1a425d4a548 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:04.241769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:04.242717 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:04.243006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:04.243280 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:04.253273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:04.254692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:04.271722 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1407/2756] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:04.698197 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:04.699585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:04.717813 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b36a-1108-4c35-bdaa-fae514243e8a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:04.723553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:04.724466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:04.724779 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:04.725056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] PATH_INFO: `/v3/projects/d1e374dab47942eabb6b8918d44b1521` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:04.726286 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e374dab47942eabb6b8918d44b1521)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:04.728181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:04.781841 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e374dab47942eabb6b8918d44b1521', 'request_id': 'req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.787357 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e374dab47942eabb6b8918d44b1521', 'request_id': 'req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.794172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e374dab47942eabb6b8918d44b1521', 'request_id': 'req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.805677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] The token cache is being invalidate because project d1e374dab47942eabb6b8918d44b1521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:04.805964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.806610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.808168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1350/2757] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:04 2022] DELETE /identity/v3/projects/d1e374dab47942eabb6b8918d44b1521 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:04.812275 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:04.821947 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d52300-ae4d-4f63-83ac-05321958fe45 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:04.879120 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:04.880002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:04.880285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:04.880562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] PATH_INFO: `/v3/users/16e857e96151487296051deb32921638` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:04.881790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e857e96151487296051deb32921638)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:04.883760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:04.936616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e857e96151487296051deb32921638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.945277 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e857e96151487296051deb32921638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.946310 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e857e96151487296051deb32921638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.955363 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e857e96151487296051deb32921638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.956037 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a3bc3243-1c47-40cb-8d99-a7ea7dba8691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e857e96151487296051deb32921638'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:04.976740 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1408/2758] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:04 2022] DELETE /identity/v3/users/16e857e96151487296051deb32921638 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:05.263885 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.265504 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:05.281719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d2b0-b16d-41c9-897b-d8eaf1c56c5b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.338552 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.339417 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.339702 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.339973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] PATH_INFO: `/v3/projects/822ff66b591248709cfcd2580c770873` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.341182 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822ff66b591248709cfcd2580c770873)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.343637 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.388409 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822ff66b591248709cfcd2580c770873', 'request_id': 'req-4de3f1cb-a36c-4143-91a6-bb00557ab881'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:05.394553 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822ff66b591248709cfcd2580c770873', 'request_id': 'req-4de3f1cb-a36c-4143-91a6-bb00557ab881'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:05.401544 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822ff66b591248709cfcd2580c770873', 'request_id': 'req-4de3f1cb-a36c-4143-91a6-bb00557ab881'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:05.413535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] The token cache is being invalidate because project 822ff66b591248709cfcd2580c770873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:05.413819 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:05.414461 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4de3f1cb-a36c-4143-91a6-bb00557ab881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:05.416008 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1351/2759] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:05 2022] DELETE /identity/v3/projects/822ff66b591248709cfcd2580c770873 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:05.420937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.421510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.421510 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.439583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:05.440807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:05.499458 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1409/2760] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:05.508064 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.508349 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.508623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.527254 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:05.528429 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:05.537178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1352/2761] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:05.541392 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.552482 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b5c6-50d4-488c-97bf-53e147fcfc76 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.557254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.557961 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.558247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.558523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.559247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:22:05.559554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.561158 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.572554 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1410/2762] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:22:05.578145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.587318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdd41c-b27a-415c-afbe-15eb01322b7d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.591893 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.592528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.593616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.593943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.594633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.596512 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.621039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1353/2763] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:22:05.625249 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.634875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71b70-86cc-49db-b978-8a60ddf9412e admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.688240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.688925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.689206 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.689478 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.690152 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.692048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.711248 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1411/2764] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:05.715309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.726319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80045dcf-6cd2-45e5-90bb-1d6186d6425e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.730932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.731618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.731900 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.732204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.732965 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.734685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.744751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1354/2765] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:05.748417 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.758799 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d9fe-fc50-4c88-8f49-a6d5f85f427b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.763342 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.763987 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.764267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.764538 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.765985 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.767557 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b14a9-47b9-4789-9171-ebcb185ce9b2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.777121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1412/2766] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:05.781424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.791385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df0a21-0497-4942-ba2e-e892c1d87bb3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.796048 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.797051 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.797331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.797603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] PATH_INFO: `/v3/projects/bb0c0dff5aff426e9045cf2f35ba94db/users/eec8d6262e7141618bbc65fd2e2ea5b1/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.812129 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c0dff5aff426e9045cf2f35ba94db, user_id=eec8d6262e7141618bbc65fd2e2ea5b1, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.815033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:05.828967 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1355/2767] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:05 2022] PUT /identity/v3/projects/bb0c0dff5aff426e9045cf2f35ba94db/users/eec8d6262e7141618bbc65fd2e2ea5b1/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:05.839081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.839373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.839647 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.864815 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] MFA Rules not processed for user `eec8d6262e7141618bbc65fd2e2ea5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:05.865999 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:05.927795 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1413/2768] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:05.932329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:05.991106 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efb144-07fd-441c-befa-e88a64d220d5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:05.995514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:05.996181 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:05.996458 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:05.996764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:05.997443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:05.999872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.024456 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1356/2769] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:22:05 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:06.028790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.039494 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495ac5-0407-41a9-ad7c-1c3ef81ba0b5 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.094696 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.095379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.095665 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.095940 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.096618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.098558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.118406 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1414/2770] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:22:06 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:06.122441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.134633 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695c64-8f64-45bf-b186-09f856c2d4de admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.139755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.140503 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.140817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.141090 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.141829 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.143438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.155520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1357/2771] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:06.159662 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.170010 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9bbe-6824-4e26-8f13-422b8a1f34af admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.175306 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.176872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.176872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.176872 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] PATH_INFO: `/v3/projects/01d7205349de4455ac15d54a8eb941f7/users/6764375dc5794073aecf11db468aac2c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.193025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d7205349de4455ac15d54a8eb941f7, user_id=6764375dc5794073aecf11db468aac2c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.195765 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.208725 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1415/2772] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:06 2022] PUT /identity/v3/projects/01d7205349de4455ac15d54a8eb941f7/users/6764375dc5794073aecf11db468aac2c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:06.212856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.223318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e4e0c-6524-4aee-b6c0-0600357a3a91 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.289909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.290575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.290853 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.291127 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.291854 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.293491 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8dac-f485-481b-adda-e2b146a0407b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.303482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1358/2773] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:22:06.307562 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.318549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57d02-0610-42b2-992c-e3dcf1319bf8 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.323245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.324117 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.324394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.324692 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] PATH_INFO: `/v3/projects/01d7205349de4455ac15d54a8eb941f7/users/6764375dc5794073aecf11db468aac2c/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.326677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d7205349de4455ac15d54a8eb941f7, user_id=6764375dc5794073aecf11db468aac2c, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.330007 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.340820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1416/2774] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:06 2022] PUT /identity/v3/projects/01d7205349de4455ac15d54a8eb941f7/users/6764375dc5794073aecf11db468aac2c/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:06.351654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.351870 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.352086 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.380318 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] MFA Rules not processed for user `6764375dc5794073aecf11db468aac2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:06.381607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:06.453616 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1359/2775] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:06.464511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:06.466239 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:06.523002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718918-7753-460e-a373-95ab83b5b2dd admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:06.526666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:06.527311 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:06.527590 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:06.527864 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:06.582958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:06.584380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:06.593677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1417/2776] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:11.164448 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:11.176465 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebb94a-a73a-45cc-9e30-3a1ec4af4fc2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:11.181097 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:11.181746 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:11.182029 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:11.182301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:11.192568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:11.194292 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b7bc-5ee8-4707-8e70-e637454d9a4f service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:11.216727 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1360/2777] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:14.986758 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:14.988437 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:15.055115 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39361ec-57b1-4d9d-89e9-374aad98bc55 service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:15.060028 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:15.060677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:15.060971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:15.061990 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:15.063845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:15.087899 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:15.090897 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:15.100711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1418/2778] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:24.811807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01e3a-4255-45bf-9e47-b093d254dbf1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:24.812341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01e3a-4255-45bf-9e47-b093d254dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:24.812341 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01e3a-4255-45bf-9e47-b093d254dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:24.830822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bda01e3a-4255-45bf-9e47-b093d254dbf1 None None] MFA Rules not processed for user `b862c7d5db4749879a441b2a90621d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:24.831997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bda01e3a-4255-45bf-9e47-b093d254dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:24.885174 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1361/2779] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:31.825617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:31.890911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddf158-6b91-4678-bc3f-36330fec0fe8 service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:31.895573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:31.896463 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:31.896843 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:31.897130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] PATH_INFO: `/v3/users/eec8d6262e7141618bbc65fd2e2ea5b1` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:31.898339 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec8d6262e7141618bbc65fd2e2ea5b1)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:31.900255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:31.953372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec8d6262e7141618bbc65fd2e2ea5b1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:31.961401 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec8d6262e7141618bbc65fd2e2ea5b1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:31.962178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec8d6262e7141618bbc65fd2e2ea5b1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:31.970122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec8d6262e7141618bbc65fd2e2ea5b1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:31.970701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec8d6262e7141618bbc65fd2e2ea5b1'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:31.988029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1419/2780] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:31 2022] DELETE /identity/v3/users/eec8d6262e7141618bbc65fd2e2ea5b1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:22:31.992482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:31.992994 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:31.993107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:32.011277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:32.012510 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:32.071597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1362/2781] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:32.081651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:32.083102 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:32.141932 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e39c6-0dad-420f-9736-19f89615b617 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:32.145553 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:32.146190 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:32.146469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:32.146741 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:32.156179 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:32.157613 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:32.167151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1420/2782] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:32.437109 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:32.438516 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:32.450493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67d6c-c788-4839-b105-d114694a1f81 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:32.458815 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:32.459686 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:32.459964 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:32.460231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] PATH_INFO: `/v3/projects/bb0c0dff5aff426e9045cf2f35ba94db` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:32.461466 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0c0dff5aff426e9045cf2f35ba94db)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:32.463474 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:32.510268 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0c0dff5aff426e9045cf2f35ba94db', 'request_id': 'req-bedd4fe6-945d-4709-98dc-6401181da411'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.515494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0c0dff5aff426e9045cf2f35ba94db', 'request_id': 'req-bedd4fe6-945d-4709-98dc-6401181da411'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.522521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0c0dff5aff426e9045cf2f35ba94db', 'request_id': 'req-bedd4fe6-945d-4709-98dc-6401181da411'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.533541 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] The token cache is being invalidate because project bb0c0dff5aff426e9045cf2f35ba94db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:32.533826 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.534438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.535974 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1363/2783] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:32 2022] DELETE /identity/v3/projects/bb0c0dff5aff426e9045cf2f35ba94db => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:32.539905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:32.550001 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0a8f0-c37c-4119-9e17-69a1e8b5e189 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:32.602776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:32.603636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:32.603917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:32.604192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] PATH_INFO: `/v3/users/6764375dc5794073aecf11db468aac2c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:32.605391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6764375dc5794073aecf11db468aac2c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:32.607300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:32.650536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6764375dc5794073aecf11db468aac2c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.657839 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6764375dc5794073aecf11db468aac2c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.658489 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6764375dc5794073aecf11db468aac2c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.664933 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6764375dc5794073aecf11db468aac2c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.665533 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a792ac94-001f-43ea-8421-6da79fc9f17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6764375dc5794073aecf11db468aac2c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:32.682732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1421/2784] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:32 2022] DELETE /identity/v3/users/6764375dc5794073aecf11db468aac2c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:32.935569 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:32.937283 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:32.952733 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4fe6-945d-4709-98dc-6401181da411 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.008825 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.009690 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.009968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.010251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] PATH_INFO: `/v3/projects/01d7205349de4455ac15d54a8eb941f7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.011412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d7205349de4455ac15d54a8eb941f7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.013344 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.057996 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d7205349de4455ac15d54a8eb941f7', 'request_id': 'req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:33.063386 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d7205349de4455ac15d54a8eb941f7', 'request_id': 'req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:33.070337 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d7205349de4455ac15d54a8eb941f7', 'request_id': 'req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:33.080871 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] The token cache is being invalidate because project 01d7205349de4455ac15d54a8eb941f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:33.081158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:33.081774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fe8894e9-6d29-4e1e-bfee-7d23da7f7c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:33.083317 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1364/2785] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:32 2022] DELETE /identity/v3/projects/01d7205349de4455ac15d54a8eb941f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:22:33.088183 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.088679 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.088852 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.107121 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:33.108952 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:33.166736 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1422/2786] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:33.174824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.175113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.175393 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.193262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:33.194445 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:33.202814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1365/2787] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:33.207088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.216681 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e9c4-5666-42ff-9a5b-40d9ed306a3b None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.221953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.222599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.222879 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.223150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.223867 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:22:33.224172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.225769 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.237321 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1423/2788] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:22:33.241624 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.251195 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e482a3-894c-496d-8033-fabcd30773ae None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.255770 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.256403 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.256709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.256979 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.257654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.259521 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.283563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1366/2789] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:22:33.287712 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.298309 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d763d-219a-476f-b192-71741749fe6b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.353061 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.353651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.353953 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.354222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.354904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.356798 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.374960 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1424/2790] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:33.379108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.388973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129fac-933c-44df-9491-6914ac75a16b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.394035 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.394677 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.394949 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.395217 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.395930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.397524 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.409065 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1367/2791] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:33.413018 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.423566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9efb2-5fea-4450-a9b8-bc0d62649159 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.428137 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.428817 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.429101 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.429377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.430093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.431698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a62576-ae16-4138-994c-a821b8e44a62 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.445545 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1425/2792] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:33.447188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.457149 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312369-d934-4eee-80ec-b8768259dc36 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.461882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.462757 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.463036 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.463315 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] PATH_INFO: `/v3/projects/d4af97f3b3d64f619bc38c4205408568/users/8b0418881bda448293a751b9ea5a1260/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.478232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4af97f3b3d64f619bc38c4205408568, user_id=8b0418881bda448293a751b9ea5a1260, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.480881 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.495950 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1368/2793] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:33 2022] PUT /identity/v3/projects/d4af97f3b3d64f619bc38c4205408568/users/8b0418881bda448293a751b9ea5a1260/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:33.506796 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.507224 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.507558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.535000 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] MFA Rules not processed for user `8b0418881bda448293a751b9ea5a1260`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:33.536194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:33.599503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1426/2794] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:33.604032 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.663716 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3f66-043f-4ad4-b4bd-5626733a70b3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.668281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.669103 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.669385 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.669659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.670336 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.672880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.696108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1369/2795] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:33.700925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.711428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e95c-75d1-415f-aa06-ecad692181fd None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.766786 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.767502 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.767783 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.768063 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.768791 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.770729 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.792814 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1427/2796] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:22:33 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:33.797742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.808256 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a6c-e223-4564-a1b4-b4c2f9e178b7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.812923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.813586 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.813865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.814141 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.814868 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.816457 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.827356 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1370/2797] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:33.831377 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.841150 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53412ad6-85dd-426f-b41e-ee5ca0e7147c admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.846511 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.847380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.847657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.847926 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] PATH_INFO: `/v3/projects/c1aea290b7894ab597e7ff0fef02e47a/users/fbddf3b315744fcc8c656a9179484a50/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.863127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aea290b7894ab597e7ff0fef02e47a, user_id=fbddf3b315744fcc8c656a9179484a50, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.865930 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.879394 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1428/2798] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:33 2022] PUT /identity/v3/projects/c1aea290b7894ab597e7ff0fef02e47a/users/fbddf3b315744fcc8c656a9179484a50/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:22:33.883196 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.894381 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34bd8-c8cb-4cec-bc58-0e629ca1e5f6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.956719 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.957314 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.957614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.957882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.958631 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.960347 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e512d6-ce42-40c9-b0ba-bed3afefc383 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:33.971585 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1371/2799] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:33.975732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:33.986409 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc25a6-ad37-41eb-935b-8cd498e089d1 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:33.991762 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:33.992811 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:33.993128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:33.993400 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] PATH_INFO: `/v3/projects/c1aea290b7894ab597e7ff0fef02e47a/users/fbddf3b315744fcc8c656a9179484a50/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:33.995378 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aea290b7894ab597e7ff0fef02e47a, user_id=fbddf3b315744fcc8c656a9179484a50, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:33.998062 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:34.008884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1429/2800] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:33 2022] PUT /identity/v3/projects/c1aea290b7894ab597e7ff0fef02e47a/users/fbddf3b315744fcc8c656a9179484a50/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:34.020613 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.021180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.021180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.049890 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] MFA Rules not processed for user `fbddf3b315744fcc8c656a9179484a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:34.051145 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:34.120803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1372/2801] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:34.131924 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:34.133674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:34.188236 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7dbe-d941-45d8-a9f9-3da4ce530d84 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:34.191847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:34.192484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.192805 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.193081 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.202232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:34.203636 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:34.212790 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1430/2802] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:34.281487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:34.290914 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb641-22e0-48e3-b0f0-1c2ae27dd0ab None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:34.294412 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:34.295040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.295316 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.295694 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.350164 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:34.351600 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eb9b9-7b0d-42ec-8e7f-e3692ce561c8 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:34.360352 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1373/2803] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:34.612896 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:34.675563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ef0a-38be-4c83-aef9-1439995cddea service cinder] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:34.680046 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:34.680972 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.681255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.681529 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] PATH_INFO: `/v3/users/8b0418881bda448293a751b9ea5a1260` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.682710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0418881bda448293a751b9ea5a1260)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:34.684718 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:34.731155 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0418881bda448293a751b9ea5a1260'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:34.738418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0418881bda448293a751b9ea5a1260'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:34.739221 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0418881bda448293a751b9ea5a1260'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:34.746322 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0418881bda448293a751b9ea5a1260'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:34.746988 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0418881bda448293a751b9ea5a1260'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:34.765194 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1431/2804] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:34 2022] DELETE /identity/v3/users/8b0418881bda448293a751b9ea5a1260 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:34.769597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.769882 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.770178 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.786888 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:34.788061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:34.845040 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1374/2805] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:34.854580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:34.855939 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:34.912105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed38c6-2752-443a-bd42-329716c5de3f admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:34.915709 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:34.916347 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:34.916630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:34.916935 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:34.926330 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:34.927670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:34.937470 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1432/2806] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:35.191180 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:35.193306 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:35.207367 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6042-8f7d-4ca6-90d8-12ea7e4faa21 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:35.213419 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:35.214108 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.214442 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.214640 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] PATH_INFO: `/v3/projects/d4af97f3b3d64f619bc38c4205408568` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:35.215822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4af97f3b3d64f619bc38c4205408568)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:35.218390 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:35.262966 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4af97f3b3d64f619bc38c4205408568', 'request_id': 'req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.268188 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4af97f3b3d64f619bc38c4205408568', 'request_id': 'req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.275308 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4af97f3b3d64f619bc38c4205408568', 'request_id': 'req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.286876 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] The token cache is being invalidate because project d4af97f3b3d64f619bc38c4205408568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:35.287159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.287774 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.289338 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1375/2807] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:35 2022] DELETE /identity/v3/projects/d4af97f3b3d64f619bc38c4205408568 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:35.293287 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:35.303276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8464ec-7239-4de2-8929-96c6c79d9725 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:35.357272 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:35.358735 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.359014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.359285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] PATH_INFO: `/v3/users/fbddf3b315744fcc8c656a9179484a50` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:35.360467 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbddf3b315744fcc8c656a9179484a50)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:35.362416 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:35.407949 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbddf3b315744fcc8c656a9179484a50'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.415468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbddf3b315744fcc8c656a9179484a50'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.416212 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbddf3b315744fcc8c656a9179484a50'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.424002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbddf3b315744fcc8c656a9179484a50'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.424885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-a2f4c9dd-987c-4273-9860-8f9cec37a0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbddf3b315744fcc8c656a9179484a50'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.441793 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1433/2808] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:22:35 2022] DELETE /identity/v3/users/fbddf3b315744fcc8c656a9179484a50 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:35.701382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:35.703301 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:35.718002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d753-9fbf-4e80-91d9-a9dbe30ff6dd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:35.775243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:35.775872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.776153 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.776420 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] PATH_INFO: `/v3/projects/c1aea290b7894ab597e7ff0fef02e47a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:35.777636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1aea290b7894ab597e7ff0fef02e47a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:35.779526 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:35.825834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1aea290b7894ab597e7ff0fef02e47a', 'request_id': 'req-6b74fa9c-790f-4f70-8859-761a51255b54'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.831812 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1aea290b7894ab597e7ff0fef02e47a', 'request_id': 'req-6b74fa9c-790f-4f70-8859-761a51255b54'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.838942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1aea290b7894ab597e7ff0fef02e47a', 'request_id': 'req-6b74fa9c-790f-4f70-8859-761a51255b54'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.850743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] The token cache is being invalidate because project c1aea290b7894ab597e7ff0fef02e47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:22:35.851025 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.851650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6b74fa9c-790f-4f70-8859-761a51255b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:22:35.853839 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1376/2809] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:22:35 2022] DELETE /identity/v3/projects/c1aea290b7894ab597e7ff0fef02e47a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:22:35.858910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.859198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.859477 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:35.879276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:35.880454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:35.940303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1434/2810] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:35.947927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.948210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.948511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:35.968168 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:35.969378 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:35.978505 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1377/2811] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:35.982871 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:35.993547 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf834-cec0-40b0-bee2-0b00c07924f1 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:35.998098 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:35.999185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:35.999472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:35.999749 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.000476 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:22:36.000992 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.002661 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.014916 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1435/2812] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:22:36.018968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.027968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be267-9998-489a-bb71-92ba777e2a76 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.033611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.034260 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.034522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.034800 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.035487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.037415 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.064604 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1378/2813] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:22:36 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:36.069088 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.079756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9700e-4b85-4648-bfdb-4675af8f9ce1 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.142566 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.143247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.143530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.143816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.144490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.146453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.166362 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1436/2814] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:22:36 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:22:36.170438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.183790 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e506e9-aa65-46c5-9d5f-a85c92f69d81 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.188948 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.189607 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.189889 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.190160 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.191014 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.192612 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.204981 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1379/2815] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:22:36.208878 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.219254 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662afa7-f461-42a9-9421-a85da4e66037 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.224201 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.224894 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.225178 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.225454 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.226181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.227755 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e779-9cdb-49db-8e0c-041bfa1982e0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.238138 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1437/2816] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:22:36.242387 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.252606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7ce8a-94b9-4308-8a4a-08cc096c74b6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.257382 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.258262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.258563 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.258831 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] PATH_INFO: `/v3/projects/dea2aac946da4a7fa53a3833e38b8281/users/234fcd2fec9c4f738ea8e3fc638014a7/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.273117 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea2aac946da4a7fa53a3833e38b8281, user_id=234fcd2fec9c4f738ea8e3fc638014a7, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.275764 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.289712 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1380/2817] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:22:36 2022] PUT /identity/v3/projects/dea2aac946da4a7fa53a3833e38b8281/users/234fcd2fec9c4f738ea8e3fc638014a7/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:22:36.300622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2e0f-f070-4bde-a823-056de18dcd26 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.301153 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2e0f-f070-4bde-a823-056de18dcd26 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.301255 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2e0f-f070-4bde-a823-056de18dcd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.328090 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-7b3c2e0f-f070-4bde-a823-056de18dcd26 None None] MFA Rules not processed for user `234fcd2fec9c4f738ea8e3fc638014a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:36.329336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-7b3c2e0f-f070-4bde-a823-056de18dcd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:36.392981 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1438/2818] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:36.404080 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:36.406113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:36.466371 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8994f-007d-46d1-a0aa-c7c86c3ca32a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:36.470723 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:36.471402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:36.471676 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:36.471944 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:36.480379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:36.481844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:36.491273 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1381/2819] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:22:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:43.147701 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e206-d4c1-4855-a2ad-995f322a85fe None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:43.148256 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e206-d4c1-4855-a2ad-995f322a85fe None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:43.148816 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e206-d4c1-4855-a2ad-995f322a85fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:43.167863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-dff1e206-d4c1-4855-a2ad-995f322a85fe None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:43.169084 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-dff1e206-d4c1-4855-a2ad-995f322a85fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:43.225228 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1439/2820] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 10 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:43.271062 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:43.272464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:43.338933 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9153d-aaea-492b-bd6e-e8a53bb0235d service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:43.344124 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:43.344824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:43.345107 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:43.345377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:43.353263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:43.354820 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:43.362669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1382/2821] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:23:01.531461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:01.531917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:01.532027 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:01.550764 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] MFA Rules not processed for user `8eb26f48e2ae4e52a9cf1ebba06bdd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:01.551997 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:01.559274 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1440/2822] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 10 03:23:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:01.572821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:01.583587 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cf8-f43e-49f7-b67a-ee730ddc64a6 service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:01.588737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40e88dcd650d4783979ca3fd848203bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:01.589377 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:01.589654 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:01.589927 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:01.598528 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:01.600121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:01.608603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1383/2823] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 10 03:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:23:03.792156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:03.793582 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:03.866713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50109d-4cec-4d38-b34b-015c7c587608 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:03.871267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:03.872143 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:03.872423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:03.872723 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] PATH_INFO: `/v3/users/b862c7d5db4749879a441b2a90621d7c` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:03.873928 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b862c7d5db4749879a441b2a90621d7c)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:03.875859 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:03.923071 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b862c7d5db4749879a441b2a90621d7c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:03.930776 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b862c7d5db4749879a441b2a90621d7c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:03.931481 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b862c7d5db4749879a441b2a90621d7c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:03.939380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b862c7d5db4749879a441b2a90621d7c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:03.940671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b862c7d5db4749879a441b2a90621d7c'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:03.958447 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1441/2824] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:23:03 2022] DELETE /identity/v3/users/b862c7d5db4749879a441b2a90621d7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:23:04.134249 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:04.147703 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24cb0-9194-400e-bb13-c445ad722938 service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:04.208362 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:04.209263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:04.209548 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:04.209821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] PATH_INFO: `/v3/projects/c224356accca4d1bbf7a2440aa0d9b89` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:04.211023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c224356accca4d1bbf7a2440aa0d9b89)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:04.212985 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:04.258817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c224356accca4d1bbf7a2440aa0d9b89', 'request_id': 'req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:04.263907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c224356accca4d1bbf7a2440aa0d9b89', 'request_id': 'req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:04.270995 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c224356accca4d1bbf7a2440aa0d9b89', 'request_id': 'req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:04.284263 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] The token cache is being invalidate because project c224356accca4d1bbf7a2440aa0d9b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:23:04.284564 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:04.285277 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-96e12a01-cdab-4b9d-b0cf-3fde4a4ad0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:04.286767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1384/2825] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:23:04 2022] DELETE /identity/v3/projects/c224356accca4d1bbf7a2440aa0d9b89 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:23:14.753031 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:14.755827 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:14.777298 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e639d2-424f-49b7-bf4c-e925013263a5 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:14.841490 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:14.843021 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:14.843536 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:14.844041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] PATH_INFO: `/v3/users/234fcd2fec9c4f738ea8e3fc638014a7` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:14.849105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234fcd2fec9c4f738ea8e3fc638014a7)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:14.851110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:14.901428 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234fcd2fec9c4f738ea8e3fc638014a7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:14.908393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234fcd2fec9c4f738ea8e3fc638014a7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:14.909087 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234fcd2fec9c4f738ea8e3fc638014a7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:14.916875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234fcd2fec9c4f738ea8e3fc638014a7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:14.917486 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234fcd2fec9c4f738ea8e3fc638014a7'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:14.934320 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1442/2826] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:23:14 2022] DELETE /identity/v3/users/234fcd2fec9c4f738ea8e3fc638014a7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:23:14.938844 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:14.939350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:14.939480 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:14.957769 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:14.958937 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.015469 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1385/2827] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:15.025237 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.026604 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.083549 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a42f-7660-48de-be65-83b8311e95a0 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.087154 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.087792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.088067 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.088337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.096925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.098512 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2b20-22b9-498f-82dc-80a9a2c2467b service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.107563 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1443/2828] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:23:15.363932 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.365351 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.377596 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18036-6f04-4be0-bcff-b52576e58235 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.382537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.383495 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.383834 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.384198 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] PATH_INFO: `/v3/projects/dea2aac946da4a7fa53a3833e38b8281` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.386009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea2aac946da4a7fa53a3833e38b8281)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.388475 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.434291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea2aac946da4a7fa53a3833e38b8281', 'request_id': 'req-f2dbafbf-5746-4f18-933f-c534fc58c17d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:15.439455 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea2aac946da4a7fa53a3833e38b8281', 'request_id': 'req-f2dbafbf-5746-4f18-933f-c534fc58c17d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:15.446650 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea2aac946da4a7fa53a3833e38b8281', 'request_id': 'req-f2dbafbf-5746-4f18-933f-c534fc58c17d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:15.457577 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] The token cache is being invalidate because project dea2aac946da4a7fa53a3833e38b8281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:23:15.457803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:15.458424 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f2dbafbf-5746-4f18-933f-c534fc58c17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:23:15.460020 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1386/2829] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:23:15 2022] DELETE /identity/v3/projects/dea2aac946da4a7fa53a3833e38b8281 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:23:15.465199 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.465483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.465756 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.483667 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:15.484902 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.541804 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1444/2830] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:15.549499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.549804 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.550079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.568525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:15.569755 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.577447 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1387/2831] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:15.581497 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.591148 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8534e-d406-4b4d-9d20-153d8f8fe5e2 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.595716 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.596368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.596677 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.596951 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.598294 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:23:15.598600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.600192 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.611246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1445/2832] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:23:15.615971 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.625379 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afca2-d778-4120-a9e9-83ba3b155f80 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.630859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.631515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.631778 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.632049 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.632786 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.634666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.659515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1388/2833] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:23:15 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:23:15.664457 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.674284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0936b-11f9-42da-8e0c-7ce8ddd7c775 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.728775 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.729365 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.729648 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.729925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.730610 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.732491 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.751507 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1446/2834] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:23:15 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:23:15.755767 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.765968 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe533-853e-43fe-9b2c-ccd5bf5b8cba admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.771007 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.771648 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.771925 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.772190 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.772942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.774501 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.785340 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1389/2835] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:23:15.789151 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.798831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef2b5-c411-47bc-a4be-104e44eb3c8b admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.803488 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.804134 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.804423 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.804732 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.805469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.807040 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef327e4-eea2-4c2c-a37a-c4ea8ed307a0 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.817468 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1447/2836] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:23:15.821392 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.831185 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95aa66-e7a3-482b-9421-7d9b9399aa2b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:15.837668 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:15.838535 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.838830 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.839101 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] PATH_INFO: `/v3/projects/d27c98ff77b04578b98906b2f6e6b449/users/b0a2a1e98e494e3992f0524efb235da3/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.854590 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27c98ff77b04578b98906b2f6e6b449, user_id=b0a2a1e98e494e3992f0524efb235da3, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:15.857248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:15.870647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1390/2837] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:23:15 2022] PUT /identity/v3/projects/d27c98ff77b04578b98906b2f6e6b449/users/b0a2a1e98e494e3992f0524efb235da3/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:23:15.875578 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381ef3-5ae4-477a-ad68-e869454ead4d None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:15.875870 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381ef3-5ae4-477a-ad68-e869454ead4d None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:15.876146 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381ef3-5ae4-477a-ad68-e869454ead4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:15.893188 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-43381ef3-5ae4-477a-ad68-e869454ead4d None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:15.895157 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-43381ef3-5ae4-477a-ad68-e869454ead4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:15.951427 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1448/2838] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:15.961742 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:15.963479 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:16.018176 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f834-f0c5-4cb6-85ef-068091724c30 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:16.022485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:16.023115 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:16.023391 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:16.023659 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:16.032717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:16.034487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:16.045042 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1391/2839] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:23:19.972719 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:19.973336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:19.973336 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:19.999348 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] MFA Rules not processed for user `b0a2a1e98e494e3992f0524efb235da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:20.000671 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:20.068288 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1449/2840] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:23:20.072843 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.082896 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed830ed-543a-4056-82ba-166479141077 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.087675 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.088329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.088606 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.088908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.089611 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.091499 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.124493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1392/2841] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:23:20 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:23:20.129278 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.139876 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b5bbe-b8c6-4947-9f2f-ac390f7bdf53 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.199726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.199726 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.200047 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.200226 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.201110 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.209657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.233204 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1450/2842] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:23:20 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:23:20.237076 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.247593 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ce40-f775-4e2e-9118-869c289e9d42 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.252093 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.252775 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.253079 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.254013 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.254880 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.256685 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.272952 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1393/2843] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:23:20.277161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.288200 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335d4cd-ba1b-48b2-8aab-814269e69bba admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.292965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.293847 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.294128 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.294396 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] PATH_INFO: `/v3/projects/da9f5c30f4404ba28c99011d92a6dac0/users/8eba77ed06e44cacb9932bc47cb2e053/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.312017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f5c30f4404ba28c99011d92a6dac0, user_id=8eba77ed06e44cacb9932bc47cb2e053, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.314825 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.329908 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1451/2844] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:23:20 2022] PUT /identity/v3/projects/da9f5c30f4404ba28c99011d92a6dac0/users/8eba77ed06e44cacb9932bc47cb2e053/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:23:20.333837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.345324 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd186e-d59c-4597-9e87-461099db3728 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.436410 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.437609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.437907 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.438186 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.439126 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.441838 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f43adc-20d0-4ac7-bf06-2b3b526ce176 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.452539 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1394/2845] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:23:20.456622 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:20.467123 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29179339-3a13-4e55-8aab-72d949366916 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:20.472514 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:20.473630 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:20.473911 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:20.474185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] PATH_INFO: `/v3/projects/da9f5c30f4404ba28c99011d92a6dac0/users/8eba77ed06e44cacb9932bc47cb2e053/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:20.476792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f5c30f4404ba28c99011d92a6dac0, user_id=8eba77ed06e44cacb9932bc47cb2e053, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:20.479695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:20.492267 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1452/2846] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:23:20 2022] PUT /identity/v3/projects/da9f5c30f4404ba28c99011d92a6dac0/users/8eba77ed06e44cacb9932bc47cb2e053/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:23:24.906738 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e644-76d7-4496-8649-bb3521df02ba None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:24.907291 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e644-76d7-4496-8649-bb3521df02ba None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:24.907421 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e644-76d7-4496-8649-bb3521df02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:24.935656 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5559e644-76d7-4496-8649-bb3521df02ba None None] MFA Rules not processed for user `8eba77ed06e44cacb9932bc47cb2e053`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:24.937253 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5559e644-76d7-4496-8649-bb3521df02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:25.012146 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1395/2847] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:25.027694 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:25.029680 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:25.111064 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879050-b019-483b-ab2e-a8947c620152 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:25.117493 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:25.118177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:25.118600 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:25.119060 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:25.183624 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:25.185369 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:25.195264 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1453/2848] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:23:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:23:27.180855 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:27.181875 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:27.182331 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:27.200228 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] MFA Rules not processed for user `b0a2a1e98e494e3992f0524efb235da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:27.201743 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:27.208835 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1396/2849] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:23:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:58.585168 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:58.586570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:58.642515 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c5d91-5528-4847-ab7f-bfe4f91ceefe service nova] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:58.646112 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:58.646738 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:58.647016 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:58.647285 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:58.656380 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:58.658068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:58.667049 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1454/2850] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:15.377394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:15.388218 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dae25a-591b-427f-a3b1-65a01a44ff6e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:15.391894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:15.392614 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:15.392935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:15.393204 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:15.395173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:15.406098 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:15.407565 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:15.417210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1397/2851] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:25:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:51.111766 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:51.120086 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850425fa-78f0-4b5e-930e-84e066c9fd76 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:51.124258 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:51.124917 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:51.125193 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:51.125460 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:51.127172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:51.141273 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:51.142713 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:51.153379 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1455/2852] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:52.337192 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:52.345851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e8325-7586-4bfb-8ab0-98a7eb56c130 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:52.349384 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:52.350009 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:52.350284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:52.350550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:52.352243 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:52.365908 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:52.367309 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:52.378851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1398/2853] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:25:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:05.418785 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.427453 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f8c4-b5c9-42b8-80f4-235bf6dd25d7 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.431281 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.432014 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.432292 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.432561 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.435020 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.444845 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.446300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.456068 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1456/2854] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:05.555765 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.564766 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb136b-bbe5-4f82-8e2b-8870a13b1e02 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.568502 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.569172 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.569451 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.569724 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.571473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.585865 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.587368 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.598960 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1399/2855] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:05.658093 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.659710 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.724105 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f7a34-cc3c-461c-bab0-5c59e224ef0d service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.728914 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.729544 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.730381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.730649 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.732350 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.743129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.744703 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.754216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1457/2856] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:06.791460 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.793121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.807310 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbba68-cccd-4ae9-9f08-26a7941572b0 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.813350 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.813997 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.814279 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.814554 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.816366 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.830039 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.831630 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.843709 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1400/2857] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:26:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:16.694583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:16.695979 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:16.777393 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697a4b-640d-40ca-9117-4b66ab8a49fa service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:16.783666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:16.784305 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:16.784698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:16.785233 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:16.786994 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:16.798246 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:16.799792 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:16.811821 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1458/2858] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:27:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:31.879751 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:31.931894 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48db20-c2af-4f6e-877c-3e034047a9d9 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:31.938520 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:31.939158 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:31.939438 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:31.939708 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:31.941514 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:31.955394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:31.957084 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:31.968509 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1401/2859] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:27:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:42.060820 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:42.139697 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb481a9-85f2-4c8e-8429-146047189ec0 service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:42.144118 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:42.145012 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:42.145290 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:42.145567 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] PATH_INFO: `/v3/users/b0a2a1e98e494e3992f0524efb235da3` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:42.146724 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a2a1e98e494e3992f0524efb235da3)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:42.148618 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:42.193262 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a2a1e98e494e3992f0524efb235da3'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.200240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a2a1e98e494e3992f0524efb235da3'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.200925 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a2a1e98e494e3992f0524efb235da3'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.207774 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a2a1e98e494e3992f0524efb235da3'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.208371 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a2a1e98e494e3992f0524efb235da3'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.225642 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1459/2860] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:27:42 2022] DELETE /identity/v3/users/b0a2a1e98e494e3992f0524efb235da3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:42.391797 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:42.401916 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674e05f-5e00-476f-8db5-7c94eed68f58 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:42.469859 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:42.470717 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:42.471011 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:42.471280 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] PATH_INFO: `/v3/projects/d27c98ff77b04578b98906b2f6e6b449` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:42.472441 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27c98ff77b04578b98906b2f6e6b449)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:42.474375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:42.521033 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27c98ff77b04578b98906b2f6e6b449', 'request_id': 'req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.529278 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27c98ff77b04578b98906b2f6e6b449', 'request_id': 'req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.536856 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27c98ff77b04578b98906b2f6e6b449', 'request_id': 'req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.561942 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] The token cache is being invalidate because project d27c98ff77b04578b98906b2f6e6b449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:27:42.562231 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.562837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.564405 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1402/2861] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:27:42 2022] DELETE /identity/v3/projects/d27c98ff77b04578b98906b2f6e6b449 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:42.568300 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:42.569727 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:42.583180 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3588-3439-42bd-968a-3260723aa6cf admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:42.638420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:42.639284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:42.639565 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:42.639840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] PATH_INFO: `/v3/users/8eba77ed06e44cacb9932bc47cb2e053` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:42.641048 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eba77ed06e44cacb9932bc47cb2e053)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:42.643025 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:42.688337 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eba77ed06e44cacb9932bc47cb2e053'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.694892 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eba77ed06e44cacb9932bc47cb2e053'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.695543 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eba77ed06e44cacb9932bc47cb2e053'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.702944 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eba77ed06e44cacb9932bc47cb2e053'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.703594 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-8e137847-c479-43c4-a386-c7b37520cdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eba77ed06e44cacb9932bc47cb2e053'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:42.720687 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1460/2862] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:27:42 2022] DELETE /identity/v3/users/8eba77ed06e44cacb9932bc47cb2e053 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:42.884010 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:42.885463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:42.899325 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73764b7a-7429-4d9a-bd13-c5f2a30c06dd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:42.956131 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:42.957023 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:42.957300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:42.957568 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] PATH_INFO: `/v3/projects/da9f5c30f4404ba28c99011d92a6dac0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:42.958734 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9f5c30f4404ba28c99011d92a6dac0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:42.960610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.005159 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9f5c30f4404ba28c99011d92a6dac0', 'request_id': 'req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:43.010736 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9f5c30f4404ba28c99011d92a6dac0', 'request_id': 'req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:43.018333 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9f5c30f4404ba28c99011d92a6dac0', 'request_id': 'req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:43.029777 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] The token cache is being invalidate because project da9f5c30f4404ba28c99011d92a6dac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:27:43.030061 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:43.030684 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c5230f6-f23a-4394-a6c5-049f5ad0d06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:43.032222 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1403/2863] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:27:42 2022] DELETE /identity/v3/projects/da9f5c30f4404ba28c99011d92a6dac0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:43.037673 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.037965 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.038245 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.074189 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:43.076079 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:43.131971 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1461/2864] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:43.140321 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.140610 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.140922 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.159649 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:43.161056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:43.169163 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1404/2865] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:43.173340 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.182657 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4870-8407-46d7-bdad-0f9ebf92feee None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.187904 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.188570 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.188885 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.189162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.189889 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:27:43.190196 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.191780 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.203807 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1462/2866] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 10 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:27:43.207917 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.217030 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbe117-0504-4542-a4ac-d7271e82a3a8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.221705 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.222346 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.222618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.222884 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.223575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.225496 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.250627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1405/2867] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:27:43 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:27:43.254583 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.264921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96d3c-e801-442a-b56a-9647d222ab13 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.317650 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.318303 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.318581 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.318857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.319551 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.321599 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.339530 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1463/2868] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:27:43 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:27:43.344248 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.354376 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac5746-1b41-4826-841f-273ec1bf4107 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.359551 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.360207 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.360487 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.360806 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.361532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.363113 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.373446 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1406/2869] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:43.377026 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.386575 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0634f2-f57a-4618-b9e1-990d3147c9e2 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.391240 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.391880 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.392161 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.392434 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.393185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.394761 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e6824-c8fb-43e3-8dba-4b1386bbfdd7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.405485 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1464/2870] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:43.409232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.420056 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964ad8a-6d59-4eb1-b2b2-f1693e75b785 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.424636 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.425525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.425808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.426110 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] PATH_INFO: `/v3/projects/d31c39583b8343bd98bdc64d7659bd9a/users/4907ee21ee894003a8a237c99302ed88/roles/adc3123199d941ea88fc13d1bb807ff1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.440171 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31c39583b8343bd98bdc64d7659bd9a, user_id=4907ee21ee894003a8a237c99302ed88, role_id=adc3123199d941ea88fc13d1bb807ff1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.442840 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.455003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1407/2871] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:27:43 2022] PUT /identity/v3/projects/d31c39583b8343bd98bdc64d7659bd9a/users/4907ee21ee894003a8a237c99302ed88/roles/adc3123199d941ea88fc13d1bb807ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:43.460100 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206994a-8123-467a-834b-94eb3148da89 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.460484 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206994a-8123-467a-834b-94eb3148da89 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.460789 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206994a-8123-467a-834b-94eb3148da89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.477731 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-b206994a-8123-467a-834b-94eb3148da89 None None] MFA Rules not processed for user `d17410a7e6f74e8cbdb88de8e641816d`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:43.478943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b206994a-8123-467a-834b-94eb3148da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:43.537651 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1465/2872] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:43.547808 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:43.549522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:43.624473 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158366-e438-4c6f-8cca-4d5551d6817c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:43.628139 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:43.628814 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:43.629100 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:43.629375 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:43.638402 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:43.639822 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:43.649038 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1408/2873] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:47.337862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.338397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.338397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.365558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] MFA Rules not processed for user `4907ee21ee894003a8a237c99302ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:47.366695 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:47.434617 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1466/2874] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:27:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:47.439579 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.450095 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330a109-30fb-4a91-990e-afa68009432f service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.454748 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.455394 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.455669 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.455939 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.456619 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.458532 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.488845 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1409/2875] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 10 03:27:47 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:27:47.489910 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.500782 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad4ed5-99ce-43a2-beaf-b3a6aa5f3518 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.562943 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.563623 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.563905 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.564177 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] PATH_INFO: `/v3/users` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.564912 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.567439 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.591568 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1467/2876] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 10 03:27:47 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:27:47.592749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.603261 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca71b-c9d6-4591-bd80-e704a9b4ec76 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.608464 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.609259 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.609550 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.609803 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.610525 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.612118 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.623238 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1410/2877] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:47.627584 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.638399 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300255-c138-471c-b3e8-d71853a6ef31 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.643114 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.644002 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.644284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.644587 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] PATH_INFO: `/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d/users/987d5777691c448cb3e8d413f2587155/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.661391 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b5d2a6096c47c0aaff33a8d4f1656d, user_id=987d5777691c448cb3e8d413f2587155, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.664276 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.698921 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1468/2878] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:27:47 2022] PUT /identity/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d/users/987d5777691c448cb3e8d413f2587155/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:47.702398 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.713824 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16a69-4d54-4581-ad63-9a963e657d1b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.772897 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.773574 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.773851 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.774121 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.774837 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.776428 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8152b-fbbe-496f-b616-3a436041dd8f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.788493 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1411/2879] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 10 03:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:47.792580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:47.803803 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36005b6-7717-4532-9060-6173104731f7 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:47.810929 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:47.811907 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] REQUEST_METHOD: `PUT` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:47.812222 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:47.812503 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] PATH_INFO: `/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d/users/987d5777691c448cb3e8d413f2587155/roles/93fe7bb88abd486bad9f0a4bb804fe11` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:47.814770 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b5d2a6096c47c0aaff33a8d4f1656d, user_id=987d5777691c448cb3e8d413f2587155, role_id=93fe7bb88abd486bad9f0a4bb804fe11)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:47.817646 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:47.829326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1469/2880] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 10 03:27:47 2022] PUT /identity/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d/users/987d5777691c448cb3e8d413f2587155/roles/93fe7bb88abd486bad9f0a4bb804fe11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:52.265909 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413cc40-f8d1-41ce-a9a4-696392f14577 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:52.266467 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413cc40-f8d1-41ce-a9a4-696392f14577 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:52.266711 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413cc40-f8d1-41ce-a9a4-696392f14577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:52.294125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5413cc40-f8d1-41ce-a9a4-696392f14577 None None] MFA Rules not processed for user `987d5777691c448cb3e8d413f2587155`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:52.295647 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5413cc40-f8d1-41ce-a9a4-696392f14577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:52.374282 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1412/2881] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:27:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:52.389472 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:52.391198 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:52.476127 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb545dcc-33e0-4f8a-93e2-a80ba0fe517a admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:52.485857 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:52.486523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:52.486802 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:52.487077 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:52.549159 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:52.550760 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:52.560909 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1470/2882] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:27:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:28:09.001281 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:09.001759 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:09.001913 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:09.018872 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] MFA Rules not processed for user `4907ee21ee894003a8a237c99302ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:28:09.020057 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:09.026905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1413/2883] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:28:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:28:09.327840 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:09.380418 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4268946-db7a-46db-9e69-41542179abf2 service nova] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:09.383937 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:09.384572 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:09.384884 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:09.385160 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:09.387006 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:09.396230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:09.397660 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:09.405957 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1471/2884] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:28:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:28:25.184053 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:25.185988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:25.197817 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14d56-969d-43b0-b01f-09c63111949a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:25.201827 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:25.202459 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:25.202735 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:25.203003 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:25.211575 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:25.213016 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37171d26-fb3e-4cd5-9de5-643e2b8f4dc7 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:25.222284 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1414/2885] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:28:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:30:21.850372 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:30:21.858846 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6ee5-4c67-44e1-804c-e94c0bb5a9b2 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:30:21.863116 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:30:21.863744 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:30:21.864019 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:30:21.864284 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:30:21.866045 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:30:21.875099 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:30:21.876498 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:30:21.884295 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1472/2886] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:30:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:30:25.696750 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:30:25.697232 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:30:25.697355 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:30:25.714725 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] MFA Rules not processed for user `4907ee21ee894003a8a237c99302ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:30:25.715945 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:30:25.723125 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1415/2887] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:30:43.796922 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:30:43.820029 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223b3a-a7f1-43fd-8ef2-55f133195dbc service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:30:43.825573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:30:43.826247 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:30:43.826532 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:30:43.826810 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:30:43.829156 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:30:43.854130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:30:43.855707 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253c085-9bcf-4013-8914-01f0becb2074 service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:30:43.866523 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1473/2888] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:30:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:32:22.652515 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:22.653935 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:22.722737 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd67ec-c031-4352-b840-93aa2c32ada9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:22.727572 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:22.728211 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:22.728488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:22.728789 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:22.730537 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:22.742114 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:22.743664 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:22.753923 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1416/2889] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:32:32.725640 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] REQUEST_METHOD: `POST` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:32.726185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:32.726185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:32.743674 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.auth.core [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] MFA Rules not processed for user `4907ee21ee894003a8a237c99302ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=80056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:32:32.744875 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:32.752181 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1474/2890] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 10 03:32:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:32:32.787545 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:32.789002 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:32.865666 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e079b-d1bc-445f-ad3d-3982ed3b93f5 service placement] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:32.869165 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5afe79ba075a4f4da308f8d982d00869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:32.869794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:32.870067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:32.870332 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:32.872102 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:32.885463 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:32.886794 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:32.897522 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1417/2891] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:32:33.592919 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:33.594964 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:33.601488 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:33.609698 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9d55-8342-4a7d-907b-64d050fa6139 None None] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:33.610785 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81f38-09ab-4cda-94cf-9ef9ea076244 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:33.614297 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:33.614601 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:33.614930 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:33.615210 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:33.615326 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:33.615485 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:33.615589 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:33.615759 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:33.617300 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:33.617483 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:33.629359 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:33.630915 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:33.631511 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:33.633067 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:33.640616 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1475/2892] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:32:33.645167 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1418/2893] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:32:36.161452 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:36.163461 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:36.196366 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ea6a-fbbd-45aa-a70a-661d451cb546 service placement] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:36.202788 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:36.203465 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:36.204420 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:36.204862 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:36.209136 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:36.222324 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:36.224130 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:36.237230 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1476/2894] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:32:46.697931 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:32:46.709943 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beac34-6962-4429-82d2-832911bad666 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:32:46.715973 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fa3765319b4024ab300ae52161d649', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:32:46.716618 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:32:46.716928 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:32:46.717199 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:32:46.719627 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:32:46.731832 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:32:46.733427 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:32:46.744609 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1419/2895] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:32:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:34:19.406564 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:19.416232 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58977f6-1808-4ab3-b437-12f1fe7e833d service nova] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:19.419745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:19.420373 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:19.420670 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:19.420958 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:19.428977 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:19.430389 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:19.438868 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1477/2896] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:34:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:34:33.614597 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:33.624120 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94458fe-2ec7-42e3-ab48-6ff93aaf9025 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:33.628443 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b14194021b484ce884af2c593d59e54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:33.629193 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:33.629622 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:33.629905 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:33.687867 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:33.690226 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:33.700088 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1420/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:34:39.985558 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:40.000595 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ee62-40f9-4c8f-85f9-304b12d33cc0 service neutron] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:40.005711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:40.006973 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:40.007299 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:40.007580 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] PATH_INFO: `/v3/users/4907ee21ee894003a8a237c99302ed88` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:40.009074 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4907ee21ee894003a8a237c99302ed88)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:40.011017 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:40.066479 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4907ee21ee894003a8a237c99302ed88'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.073162 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4907ee21ee894003a8a237c99302ed88'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.073849 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4907ee21ee894003a8a237c99302ed88'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.081140 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4907ee21ee894003a8a237c99302ed88'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.081745 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4907ee21ee894003a8a237c99302ed88'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.099129 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1478/2898] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:34:39 2022] DELETE /identity/v3/users/4907ee21ee894003a8a237c99302ed88 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:34:40.267621 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:40.278329 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df509024-f888-4b0a-bacd-99746eaafb2f service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:40.341434 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:40.342215 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:40.342494 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:40.342807 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] PATH_INFO: `/v3/projects/d31c39583b8343bd98bdc64d7659bd9a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:40.343988 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31c39583b8343bd98bdc64d7659bd9a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:40.347298 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:40.390482 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31c39583b8343bd98bdc64d7659bd9a', 'request_id': 'req-e19db96d-abc6-4cc9-bf46-0843e4b0718c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.396239 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31c39583b8343bd98bdc64d7659bd9a', 'request_id': 'req-e19db96d-abc6-4cc9-bf46-0843e4b0718c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.402977 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31c39583b8343bd98bdc64d7659bd9a', 'request_id': 'req-e19db96d-abc6-4cc9-bf46-0843e4b0718c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.414706 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] The token cache is being invalidate because project d31c39583b8343bd98bdc64d7659bd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:34:40.414989 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.415605 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.417173 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1421/2899] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:34:40 2022] DELETE /identity/v3/projects/d31c39583b8343bd98bdc64d7659bd9a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:34:40.421167 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:40.422573 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:34:40.435349 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e115d-3659-4066-a9aa-e171db1fffec admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:40.488808 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:40.489666 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:40.489945 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:40.490216 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] PATH_INFO: `/v3/users/987d5777691c448cb3e8d413f2587155` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:40.491370 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987d5777691c448cb3e8d413f2587155)` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:40.493297 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:40.538368 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987d5777691c448cb3e8d413f2587155'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.544831 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987d5777691c448cb3e8d413f2587155'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.545469 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987d5777691c448cb3e8d413f2587155'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.552711 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987d5777691c448cb3e8d413f2587155'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.553397 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.notifications [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987d5777691c448cb3e8d413f2587155'} {{(pid=80056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.570108 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1479/2900] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 10 03:34:40 2022] DELETE /identity/v3/users/987d5777691c448cb3e8d413f2587155 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:34:40.750319 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:34:40.752497 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:34:40.766288 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19db96d-abc6-4cc9-bf46-0843e4b0718c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:34:40.822864 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17410a7e6f74e8cbdb88de8e641816d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1554fd89594f468faedf42d5357b2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:34:40.823729 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:34:40.824034 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:34:40.824307 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] PATH_INFO: `/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:34:40.825623 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b5d2a6096c47c0aaff33a8d4f1656d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:34:40.827603 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:34:40.874821 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b5d2a6096c47c0aaff33a8d4f1656d', 'request_id': 'req-3748daa5-20f9-48e1-8df7-2d0f8e33431b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.880861 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b5d2a6096c47c0aaff33a8d4f1656d', 'request_id': 'req-3748daa5-20f9-48e1-8df7-2d0f8e33431b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.889251 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b5d2a6096c47c0aaff33a8d4f1656d', 'request_id': 'req-3748daa5-20f9-48e1-8df7-2d0f8e33431b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.901416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] The token cache is being invalidate because project f2b5d2a6096c47c0aaff33a8d4f1656d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:34:40.901416 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.902262 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3748daa5-20f9-48e1-8df7-2d0f8e33431b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:34:40.904749 dv-cinder-830094-4-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1422/2901] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 10 03:34:40 2022] DELETE /identity/v3/projects/f2b5d2a6096c47c0aaff33a8d4f1656d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:37:28.636464 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Authenticating user token {{(pid=80056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:37:28.637901 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:37:28.744041 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9d854-dc40-41e5-9d6e-b1f1e719cbc6 admin admin] Validating token access rules against request {{(pid=80056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:37:28.802172 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '614c1bd3422341358ed13584bfb24439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8886c28b19cf4953b82e5b20ad4b6b46', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:37:28.802818 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] REQUEST_METHOD: `GET` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:37:28.803103 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] SCRIPT_NAME: `/identity` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:37:28.803381 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:37:28.805185 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.fernet_utils [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:37:28.816122 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:37:28.818217 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41649-aeed-4ca4-9709-973736e8d14d service placement] RBAC: Authorization granted {{(pid=80056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:37:28.827863 dv-cinder-830094-4-iscsi devstack@keystone.service[80056]: [pid: 80056|app: 0|req: 1480/2902] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 10 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)